Oct 30 13:50:13 user nova-compute[74319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74319) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 13:50:13 user nova-compute[74319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74319) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 13:50:13 user nova-compute[74319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74319) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 30 13:50:13 user nova-compute[74319]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 30 13:50:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:50:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:50:14 user nova-compute[74319]: INFO nova.virt.driver [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 30 13:50:14 user nova-compute[74319]: INFO nova.compute.provider_config [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Acquiring lock "singleton_lock" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Acquired lock "singleton_lock" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Releasing lock "singleton_lock" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Full set of CONF: {{(pid=74319) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ******************************************************************************** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Configuration options gathered from: {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ================================================================================ {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] allow_resize_to_same_host      = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] arq_binding_timeout            = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] backdoor_port                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] backdoor_socket                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] block_device_allocate_retries  = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] block_device_allocate_retries_interval = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cert                           = self.pem {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute_monitors               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] config_dir                     = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] config_drive_format            = iso9660 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] config_source                  = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] console_host                   = user {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] control_exchange               = nova {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cpu_allocation_ratio           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] daemon                         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] debug                          = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_access_ip_network_name = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_availability_zone      = nova {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_ephemeral_format       = ext4 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_green_pool_size        = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] default_schedule_zone          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] disk_allocation_ratio          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] enable_new_services            = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] enabled_apis                   = ['osapi_compute'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] enabled_ssl_apis               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] flat_injected                  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] force_config_drive             = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] force_raw_images               = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] graceful_shutdown_timeout      = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] heal_instance_info_cache_interval = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] host                           = user {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_build_timeout         = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_delete_interval       = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_format                = [instance: %(uuid)s]  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_name_template         = instance-%08x {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_usage_audit           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_usage_audit_period    = month {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] internal_service_availability_zone = internal {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] key                            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] live_migration_retry_count     = 30 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_config_append              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_dir                        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_file                       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_options                    = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_rotate_interval            = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_rotate_interval_type       = days {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] log_rotation_type              = none {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] long_rpc_timeout               = 1800 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_concurrent_builds          = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_concurrent_live_migrations = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_concurrent_snapshots       = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_local_block_devices        = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_logfile_count              = 30 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] max_logfile_size_mb            = 200 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] maximum_instance_delete_attempts = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metadata_listen                = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metadata_listen_port           = 8775 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metadata_workers               = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] migrate_max_retries            = -1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] mkisofs_cmd                    = genisoimage {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] my_ip                          = 10.0.0.210 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] network_allocate_retries       = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] osapi_compute_listen_port      = 8774 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] osapi_compute_unique_server_name_scope =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] osapi_compute_workers          = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] password_length                = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] periodic_enable                = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] periodic_fuzzy_delay           = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] pointer_model                  = ps2mouse {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] preallocate_images             = none {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] publish_errors                 = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] pybasedir                      = /opt/stack/nova {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ram_allocation_ratio           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rate_limit_burst               = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rate_limit_except_level        = CRITICAL {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rate_limit_interval            = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reboot_timeout                 = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reclaim_instance_interval      = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] record                         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reimage_timeout_per_gb         = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] report_interval                = 120 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rescue_timeout                 = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reserved_host_cpus             = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reserved_host_disk_mb          = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reserved_host_memory_mb        = 512 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] reserved_huge_pages            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] resize_confirm_window          = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] resize_fs_using_block_device   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] resume_guests_state_on_host_boot = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rpc_response_timeout           = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] run_external_periodic_tasks    = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] running_deleted_instance_action = reap {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] running_deleted_instance_poll_interval = 1800 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] running_deleted_instance_timeout = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler_instance_sync_interval = 120 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_down_time              = 720 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] servicegroup_driver            = db {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] shelved_offload_time           = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] shelved_poll_interval          = 3600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] shutdown_timeout               = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] source_is_ipv6                 = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ssl_only                       = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] state_path                     = /opt/stack/data/nova {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] sync_power_state_interval      = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] sync_power_state_pool_size     = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] syslog_log_facility            = LOG_USER {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] tempdir                        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] timeout_nbd                    = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] transport_url                  = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] update_resources_interval      = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_cow_images                 = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_eventlog                   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_journal                    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_json                       = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_rootwrap_daemon            = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_stderr                     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] use_syslog                     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vcpu_pin_set                   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plugging_is_fatal          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plugging_timeout           = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] virt_mkfs                      = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] volume_usage_poll_interval     = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] watch_log_file                 = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] web                            = /usr/share/spice-html5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_concurrency.disable_process_locking = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.auth_strategy              = keystone {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.compute_link_prefix        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.dhcp_domain                = novalocal {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.enable_instance_password   = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.glance_link_prefix         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.instance_list_per_project_cells = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.list_records_by_skipping_down_cells = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.local_metadata_per_cell    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.max_limit                  = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.metadata_cache_expiration  = 15 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.neutron_default_tenant_id  = default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.use_forwarded_for          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.use_neutron_default_nets   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_dynamic_targets = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_jsonfile_path   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.backend                  = dogpile.cache.memcached {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.backend_argument         = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.config_prefix            = cache.oslo {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.dead_timeout             = 60.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.debug_cache_backend      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.enable_retry_client      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.enable_socket_keepalive  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.enabled                  = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.expiration_time          = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.hashclient_retry_attempts = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_dead_retry      = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_password        =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_pool_maxsize    = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_sasl_enabled    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.memcache_username        =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.proxies                  = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.retry_attempts           = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.retry_delay              = 0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.socket_keepalive_count   = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.socket_keepalive_idle    = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.socket_keepalive_interval = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.tls_allowed_ciphers      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.tls_cafile               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.tls_certfile             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.tls_enabled              = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cache.tls_keyfile              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.auth_section            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.auth_type               = password {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.cafile                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.certfile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.collect_timing          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.cross_az_attach         = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.debug                   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.endpoint_template       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.http_retries            = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.insecure                = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.keyfile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.os_region_name          = RegionOne {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.split_loggers           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cinder.timeout                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.cpu_dedicated_set      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.cpu_shared_set         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.image_type_exclude_list = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.max_concurrent_disk_ops = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.max_disk_devices_to_attach = -1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.resource_provider_association_refresh = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.shutdown_retry_interval = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] conductor.workers              = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] console.allowed_origins        = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] console.ssl_ciphers            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] console.ssl_minimum_version    = default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] consoleauth.token_ttl          = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.cafile                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.certfile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.collect_timing          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.connect_retries         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.connect_retry_delay     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.endpoint_override       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.insecure                = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.keyfile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.max_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.min_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.region_name             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.service_name            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.service_type            = accelerator {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.split_loggers           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.status_code_retries     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.timeout                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] cyborg.version                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.backend               = sqlalchemy {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.connection            = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.connection_debug      = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.connection_parameters =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.connection_recycle_time = 3600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.connection_trace      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.db_inc_retry_interval = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.db_max_retries        = 20 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.db_max_retry_interval = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.db_retry_interval     = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.max_overflow          = 50 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.max_pool_size         = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.max_retries           = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.mysql_wsrep_sync_wait = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.pool_timeout          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.retry_interval        = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.slave_connection      = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] database.sqlite_synchronous    = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.backend           = sqlalchemy {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.connection        = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.connection_debug  = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.connection_parameters =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.connection_recycle_time = 3600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.connection_trace  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.db_inc_retry_interval = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.db_max_retries    = 20 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.db_max_retry_interval = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.db_retry_interval = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.max_overflow      = 50 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.max_pool_size     = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.max_retries       = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.pool_timeout      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.retry_interval    = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.slave_connection  = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] api_database.sqlite_synchronous = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] devices.enabled_mdev_types     = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ephemeral_storage_encryption.enabled = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.api_servers             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.cafile                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.certfile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.collect_timing          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.connect_retries         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.connect_retry_delay     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.debug                   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.default_trusted_certificate_ids = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.enable_certificate_validation = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.enable_rbd_download     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.endpoint_override       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.insecure                = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.keyfile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.max_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.min_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.num_retries             = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.rbd_ceph_conf           =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.rbd_connect_timeout     = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.rbd_pool                =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.rbd_user                =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.region_name             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.service_name            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.service_type            = image {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.split_loggers           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.status_code_retries     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.timeout                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.verify_glance_signatures = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] glance.version                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] guestfs.debug                  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.config_drive_cdrom      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.config_drive_inject_password = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.enable_instance_metrics_collection = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.enable_remotefx         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.instances_path_share    =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.iscsi_initiator_list    = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.limit_cpu_features      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.power_state_check_timeframe = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.use_multipath_io        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.volume_attach_retry_count = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.vswitch_name            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] mks.enabled                    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.manager_interval   = 2400 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.precache_concurrency = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.remove_unused_base_images = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] image_cache.subdirectory_name  = _base {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.api_max_retries         = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.api_retry_interval      = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.auth_section            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.auth_type               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.cafile                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.certfile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.collect_timing          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.conductor_group         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.connect_retries         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.connect_retry_delay     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.endpoint_override       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.insecure                = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.keyfile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.max_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.min_version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.peer_list               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.region_name             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.serial_console_state_timeout = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.service_name            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.service_type            = baremetal {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.split_loggers           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.status_code_retries     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.timeout                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ironic.version                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] key_manager.fixed_key          = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.barbican_api_version  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.barbican_endpoint     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.barbican_endpoint_type = public {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.barbican_region_name  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.cafile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.certfile              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.collect_timing        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.insecure              = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.keyfile               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.number_of_retries     = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.retry_delay           = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.send_service_user_token = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.split_loggers         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.timeout               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.verify_ssl            = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican.verify_ssl_path       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.auth_section = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.auth_type = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.cafile   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.certfile = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.collect_timing = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.insecure = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.keyfile  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.split_loggers = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] barbican_service_user.timeout  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.approle_role_id          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.approle_secret_id        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.cafile                   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.certfile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.collect_timing           = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.insecure                 = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.keyfile                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.kv_mountpoint            = secret {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.kv_path                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.kv_version               = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.namespace                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.root_token_id            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.split_loggers            = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.ssl_ca_crt_file          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.timeout                  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.use_ssl                  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.auth_section          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.auth_type             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.cafile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.certfile              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.collect_timing        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.connect_retries       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.connect_retry_delay   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.endpoint_override     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.insecure              = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.keyfile               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.max_version           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.min_version           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.region_name           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.service_name          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.service_type          = identity {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.split_loggers         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.status_code_retries   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.timeout               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] keystone.version               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.connection_uri         =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_mode               = custom {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: WARNING oslo_config.cfg [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_power_governor_high = performance {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_power_governor_low = powersave {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_power_management   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.device_detach_attempts = 8 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.device_detach_timeout  = 20 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.disk_cachemodes        = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.disk_prefix            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.enabled_perf_events    = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.file_backed_memory     = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.gid_maps               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.hw_disk_discard        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.hw_machine_type        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_rbd_glance_store_name =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_rbd_pool        = rbd {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_type            = default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.images_volume_group    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.inject_key             = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.inject_partition       = -2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.inject_password        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.iscsi_iface            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.iser_use_multipath     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_bandwidth = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_downtime = 500 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_inbound_addr = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_permit_post_copy = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_scheme  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_timeout_action = abort {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_tunnelled = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: WARNING oslo_config.cfg [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 30 13:50:14 user nova-compute[74319]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 30 13:50:14 user nova-compute[74319]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 30 13:50:14 user nova-compute[74319]: and ``live_migration_inbound_addr`` respectively.
Oct 30 13:50:14 user nova-compute[74319]: ).  Its value may be silently ignored in the future.
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.live_migration_with_native_tls = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.max_queues             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.nfs_mount_options      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_memory_encrypted_guests = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_pcie_ports         = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.pmem_namespaces        = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.quobyte_client_cfg     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rbd_secret_uuid        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rbd_user               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.remote_filesystem_transport = ssh {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rescue_image_id        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rescue_kernel_id       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rescue_ramdisk_id      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.rx_queue_size          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.smbfs_mount_options    =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.snapshot_compression   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.snapshot_image_format  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.sparse_logical_volumes = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.swtpm_enabled          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.swtpm_group            = tss {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.swtpm_user             = tss {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.sysinfo_serial         = unique {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.tb_cache_size          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.tx_queue_size          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.uid_maps               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.use_virtio_for_bridges = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.virt_type              = kvm {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.volume_clear           = zero {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.volume_clear_size      = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.volume_use_multipath   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_cache_path   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.vzstorage_mount_user   = stack {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.auth_section           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.auth_type              = password {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.cafile                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.certfile               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.collect_timing         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.connect_retries        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.connect_retry_delay    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.default_floating_pool  = public {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.endpoint_override      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.extension_sync_interval = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.http_retries           = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.insecure               = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.keyfile                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.max_version            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.min_version            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.ovs_bridge             = br-int {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.physnets               = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.region_name            = RegionOne {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.service_metadata_proxy = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.service_name           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.service_type           = network {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.split_loggers          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.status_code_retries    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.timeout                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] neutron.version                = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] notifications.bdms_in_notifications = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] notifications.default_level    = INFO {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] notifications.notification_format = unversioned {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] notifications.notify_on_state_change = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] pci.alias                      = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] pci.device_spec                = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] pci.report_in_placement        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.auth_section         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.auth_type            = password {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.cafile               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.certfile             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.collect_timing       = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.connect_retries      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.connect_retry_delay  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.default_domain_id    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.default_domain_name  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.domain_id            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.domain_name          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.endpoint_override    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.insecure             = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.keyfile              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.max_version          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.min_version          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.password             = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.project_domain_id    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.project_domain_name  = Default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.project_id           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.project_name         = service {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.region_name          = RegionOne {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.service_name         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.service_type         = placement {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.split_loggers        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.status_code_retries  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.system_scope         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.timeout              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.trust_id             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.user_domain_id       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.user_domain_name     = Default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.user_id              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.username             = placement {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] placement.version              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.cores                    = 20 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.count_usage_from_placement = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.injected_file_content_bytes = 10240 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.injected_file_path_length = 255 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.injected_files           = 5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.instances                = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.key_pairs                = 100 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.metadata_items           = 128 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.ram                      = 51200 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.recheck_quota            = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.server_group_members     = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] quota.server_groups            = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rdp.enabled                    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.image_metadata_prefilter = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.max_attempts         = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.max_placement_results = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.query_placement_for_image_type_support = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] scheduler.workers              = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.host_subset_size = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.isolated_hosts = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.isolated_images = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.pci_in_placement = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.track_instance_changes = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metrics.required               = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metrics.weight_multiplier      = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] metrics.weight_setting         = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.enabled         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.port_range      = 10000:20000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] serial_console.serialproxy_port = 6083 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.auth_section      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.auth_type         = password {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.cafile            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.certfile          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.collect_timing    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.insecure          = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.keyfile           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.send_service_user_token = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.split_loggers     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] service_user.timeout           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.agent_enabled            = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.enabled                  = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.html5proxy_port          = 6082 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.image_compression        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.jpeg_compression         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.playback_compression     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.server_listen            = 127.0.0.1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.streaming_mode           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] spice.zlib_compression         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] upgrade_levels.baseapi         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] upgrade_levels.cert            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] upgrade_levels.compute         = auto {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] upgrade_levels.conductor       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] upgrade_levels.scheduler       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.auth_section = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.auth_type = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.cafile = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.certfile = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.insecure = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.keyfile = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vendordata_dynamic_auth.timeout = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.api_retry_count         = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.ca_file                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.cache_prefix            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.cluster_name            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.connection_pool_size    = 10 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.console_delay_seconds   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.datastore_regex         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.host_ip                 = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.host_password           = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.host_port               = 443 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.host_username           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.insecure                = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.integration_bridge      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.maximum_objects         = 100 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.pbm_default_policy      = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.pbm_enabled             = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.pbm_wsdl_location       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.serial_port_proxy_uri   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.serial_port_service_uri = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.task_poll_interval      = 0.5 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.use_linked_clone        = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.vnc_keymap              = en-us {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.vnc_port                = 5900 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vmware.vnc_port_total          = 10000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.auth_schemes               = ['none'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.enabled                    = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.novncproxy_port            = 6080 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.server_listen              = 0.0.0.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.vencrypt_ca_certs          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.vencrypt_client_cert       = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vnc.vencrypt_client_key        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.disable_rootwrap   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.enable_numa_live_migration = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.libvirt_disable_apic = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.client_socket_timeout     = 900 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.default_pool_size         = 1000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.keep_alive                = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.max_header_line           = 16384 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.ssl_ca_file               = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.ssl_cert_file             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.ssl_key_file              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.tcp_keepidle              = 600 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] zvm.ca_file                    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] zvm.cloud_connector_url        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] zvm.reachable_timeout          = 300 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.enforce_new_defaults = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.enforce_scope      = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.policy_default_rule = default {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.policy_file        = policy.yaml {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.connection_string     = messaging:// {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.enabled               = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.es_doc_type           = notification {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.es_scroll_size        = 10000 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.es_scroll_time        = 2m {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.filter_error_trace    = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.hmac_keys             = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.sentinel_service_name = mymaster {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.socket_timeout        = 0.1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.trace_requests        = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler.trace_sqlalchemy      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler_jaeger.process_tags   = {} {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler_jaeger.service_name_prefix = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] profiler_otlp.service_name_prefix = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] remote_debug.host              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] remote_debug.port              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_notifications.retry = -1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_messaging_notifications.transport_url = **** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.auth_section        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.auth_type           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.cafile              = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.certfile            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.collect_timing      = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.connect_retries     = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.connect_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.endpoint_id         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.endpoint_override   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.insecure            = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.keyfile             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.max_version         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.min_version         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.region_name         = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.service_name        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.service_type        = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.split_loggers       = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.status_code_retries = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.status_code_retry_delay = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.timeout             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.valid_interfaces    = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_limit.version             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_reports.file_event_handler = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] oslo_reports.log_dir           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.group  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] vif_plug_ovs_privileged.user   = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.flat_interface = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.isolate_vif         = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_vif_ovs.per_port_bridge     = False {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] os_brick.lock_path             = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.capabilities   = [21] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.group          = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.helper_command = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] privsep_osbrick.user           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.group           = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.helper_command  = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] nova_sys_admin.user            = None {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG oslo_service.service [None req-0820df2b-f608-4f32-9c35-f35d2cb9a18f None None] ******************************************************************************** {{(pid=74319) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 30 13:50:14 user nova-compute[74319]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Connecting to libvirt: qemu:///system {{(pid=74319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe9a166e4d0> {{(pid=74319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 30 13:50:14 user nova-compute[74319]: libvirt:  error : internal error: could not initialize domain event timer
Oct 30 13:50:14 user nova-compute[74319]: WARNING nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe9a166e4d0> {{(pid=74319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Starting native event thread {{(pid=74319) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Starting green dispatch thread {{(pid=74319) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Starting connection event dispatch thread {{(pid=74319) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 30 13:50:14 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Connection event '1' reason 'None'
Oct 30 13:50:14 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 13:50:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.mount [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Initialising _HostMountState generation 0 {{(pid=74319) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host capabilities <capabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <host>
Oct 30 13:50:22 user nova-compute[74319]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 30 13:50:22 user nova-compute[74319]:     <cpu>
Oct 30 13:50:22 user nova-compute[74319]:       <arch>x86_64</arch>
Oct 30 13:50:22 user nova-compute[74319]:       <model>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <microcode version='1070'/>
Oct 30 13:50:22 user nova-compute[74319]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='osxsave'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='invtsc'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='rsba'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature name='skip-l1dfl-vmentry'/>
Oct 30 13:50:22 user nova-compute[74319]:       <pages unit='KiB' size='4'/>
Oct 30 13:50:22 user nova-compute[74319]:       <pages unit='KiB' size='2048'/>
Oct 30 13:50:22 user nova-compute[74319]:     </cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <power_management>
Oct 30 13:50:22 user nova-compute[74319]:       <suspend_mem/>
Oct 30 13:50:22 user nova-compute[74319]:       <suspend_disk/>
Oct 30 13:50:22 user nova-compute[74319]:       <suspend_hybrid/>
Oct 30 13:50:22 user nova-compute[74319]:     </power_management>
Oct 30 13:50:22 user nova-compute[74319]:     <iommu support='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <migration_features>
Oct 30 13:50:22 user nova-compute[74319]:       <live/>
Oct 30 13:50:22 user nova-compute[74319]:       <uri_transports>
Oct 30 13:50:22 user nova-compute[74319]:         <uri_transport>tcp</uri_transport>
Oct 30 13:50:22 user nova-compute[74319]:         <uri_transport>rdma</uri_transport>
Oct 30 13:50:22 user nova-compute[74319]:       </uri_transports>
Oct 30 13:50:22 user nova-compute[74319]:     </migration_features>
Oct 30 13:50:22 user nova-compute[74319]:     <topology>
Oct 30 13:50:22 user nova-compute[74319]:       <cells num='2'>
Oct 30 13:50:22 user nova-compute[74319]:         <cell id='0'>
Oct 30 13:50:22 user nova-compute[74319]:           <memory unit='KiB'>8189224</memory>
Oct 30 13:50:22 user nova-compute[74319]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 30 13:50:22 user nova-compute[74319]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 13:50:22 user nova-compute[74319]:           <distances>
Oct 30 13:50:22 user nova-compute[74319]:             <sibling id='0' value='10'/>
Oct 30 13:50:22 user nova-compute[74319]:             <sibling id='1' value='20'/>
Oct 30 13:50:22 user nova-compute[74319]:           </distances>
Oct 30 13:50:22 user nova-compute[74319]:           <cpus num='6'>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 30 13:50:22 user nova-compute[74319]:           </cpus>
Oct 30 13:50:22 user nova-compute[74319]:         </cell>
Oct 30 13:50:22 user nova-compute[74319]:         <cell id='1'>
Oct 30 13:50:22 user nova-compute[74319]:           <memory unit='KiB'>8206460</memory>
Oct 30 13:50:22 user nova-compute[74319]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 30 13:50:22 user nova-compute[74319]:           <pages unit='KiB' size='2048'>0</pages>
Oct 30 13:50:22 user nova-compute[74319]:           <distances>
Oct 30 13:50:22 user nova-compute[74319]:             <sibling id='0' value='20'/>
Oct 30 13:50:22 user nova-compute[74319]:             <sibling id='1' value='10'/>
Oct 30 13:50:22 user nova-compute[74319]:           </distances>
Oct 30 13:50:22 user nova-compute[74319]:           <cpus num='6'>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 30 13:50:22 user nova-compute[74319]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 30 13:50:22 user nova-compute[74319]:           </cpus>
Oct 30 13:50:22 user nova-compute[74319]:         </cell>
Oct 30 13:50:22 user nova-compute[74319]:       </cells>
Oct 30 13:50:22 user nova-compute[74319]:     </topology>
Oct 30 13:50:22 user nova-compute[74319]:     <cache>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 30 13:50:22 user nova-compute[74319]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 30 13:50:22 user nova-compute[74319]:     </cache>
Oct 30 13:50:22 user nova-compute[74319]:     <secmodel>
Oct 30 13:50:22 user nova-compute[74319]:       <model>apparmor</model>
Oct 30 13:50:22 user nova-compute[74319]:       <doi>0</doi>
Oct 30 13:50:22 user nova-compute[74319]:     </secmodel>
Oct 30 13:50:22 user nova-compute[74319]:     <secmodel>
Oct 30 13:50:22 user nova-compute[74319]:       <model>dac</model>
Oct 30 13:50:22 user nova-compute[74319]:       <doi>0</doi>
Oct 30 13:50:22 user nova-compute[74319]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 30 13:50:22 user nova-compute[74319]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 30 13:50:22 user nova-compute[74319]:     </secmodel>
Oct 30 13:50:22 user nova-compute[74319]:   </host>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='alpha'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>clipper</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='armv6l'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>spitz</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>nuri</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>kzm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>z2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>tosa</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n810</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>terrier</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>midway</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>microbit</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>verdex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>highbank</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>akita</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>connex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>collie</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='armv7l'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>spitz</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>nuri</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>kzm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>z2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>tosa</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n810</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>terrier</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>midway</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>microbit</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>verdex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>highbank</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>akita</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>connex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>collie</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='aarch64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>integratorcp</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>borzoi</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>spitz</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>nuri</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-b1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatileab</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>kzm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>musca-a</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>smdkc210</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>z2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>tosa</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>sabrelite</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-eb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n810</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>n800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>versatilepb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>terrier</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mainstone</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>midway</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>musicpal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>microbit</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cubieboard</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>verdex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduino2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>raspi3b</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>raspi2b</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>cheetah</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>highbank</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>akita</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>connex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>collie</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>raspi0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <acpi default='on' toggle='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='cris'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='i686'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>isapc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>microvm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='kvm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <pae/>
Oct 30 13:50:22 user nova-compute[74319]:       <nonpae/>
Oct 30 13:50:22 user nova-compute[74319]:       <acpi default='on' toggle='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:       <apic default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='m68k'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>an5206</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>q800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>next-cube</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='microblaze'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='microblazeel'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='mips'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>malta</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='mipsel'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>malta</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='mips64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>malta</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>pica61</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>magnum</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='mips64el'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>malta</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mipssim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>pica61</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>magnum</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='16'>boston</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='ppc'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mac99</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>40p</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>taihu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='ppc64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>taihu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>40p</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mac99</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='ppc64le'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>taihu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ppce500</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>40p</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>pegasos2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>bamboo</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>g3beige</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>mac99</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sam460ex</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>ref405ep</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2048'>powernv8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='riscv32'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='8'>spike</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>opentitan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='8'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='riscv64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='8'>spike</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='5'>sifive_u</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>shakti_c</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sifive_e</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='8'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='s390x'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='sh4'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>shix</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>r2d</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='sh4eb'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>shix</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>r2d</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='sparc'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>SS-5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>SS-20</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>LX</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>SS-4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>SS-10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>Voyager</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='sparc64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sun4u</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>niagara</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>sun4v</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='x86_64'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>64</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>x-remote</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='1'>isapc</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>microvm</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='kvm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <acpi default='on' toggle='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:       <apic default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='xtensa'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>sim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>kc705</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ml605</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx200</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx60</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]:   <guest>
Oct 30 13:50:22 user nova-compute[74319]:     <os_type>hvm</os_type>
Oct 30 13:50:22 user nova-compute[74319]:     <arch name='xtensaeb'>
Oct 30 13:50:22 user nova-compute[74319]:       <wordsize>32</wordsize>
Oct 30 13:50:22 user nova-compute[74319]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='4'>sim</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>kc705</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ml605</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>virt</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx200</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>lx60</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 30 13:50:22 user nova-compute[74319]:       <domain type='qemu'/>
Oct 30 13:50:22 user nova-compute[74319]:     </arch>
Oct 30 13:50:22 user nova-compute[74319]:     <features>
Oct 30 13:50:22 user nova-compute[74319]:       <cpuselection/>
Oct 30 13:50:22 user nova-compute[74319]:       <deviceboot/>
Oct 30 13:50:22 user nova-compute[74319]:       <disksnapshot default='on' toggle='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     </features>
Oct 30 13:50:22 user nova-compute[74319]:   </guest>
Oct 30 13:50:22 user nova-compute[74319]: </capabilities>
Oct 30 13:50:22 user nova-compute[74319]: 
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-i440fx-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>i686</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='255'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'/>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='lm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ide</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-q35-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>i686</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='288'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'/>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='lm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-i440fx-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>i686</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='255'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'/>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='lm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ide</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-i386</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-q35-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>i686</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='288'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'/>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='lm'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-i440fx-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>x86_64</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='255'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>efi</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='invtsc'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='rsba'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ide</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-q35-jammy</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>x86_64</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='288'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>efi</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='invtsc'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='rsba'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-i440fx-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>x86_64</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='255'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>efi</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='invtsc'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='rsba'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ide</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 30 13:50:22 user nova-compute[74319]: <domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 30 13:50:22 user nova-compute[74319]:   <domain>kvm</domain>
Oct 30 13:50:22 user nova-compute[74319]:   <machine>pc-q35-6.2</machine>
Oct 30 13:50:22 user nova-compute[74319]:   <arch>x86_64</arch>
Oct 30 13:50:22 user nova-compute[74319]:   <vcpu max='288'/>
Oct 30 13:50:22 user nova-compute[74319]:   <iothreads supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:   <os supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='firmware'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>efi</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:     <loader supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>rom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pflash</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='readonly'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='secure'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>yes</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>no</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </loader>
Oct 30 13:50:22 user nova-compute[74319]:   </os>
Oct 30 13:50:22 user nova-compute[74319]:   <cpu>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-passthrough' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='hostPassthroughMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='maximum' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='maximumMigratable'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>on</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>off</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='host-model' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <vendor>Intel</vendor>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ss'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='vmx'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pcid'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='hypervisor'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arat'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='tsc_adjust'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='umip'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='md-clear'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='arch-capabilities'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='invtsc'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibpb'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='ibrs'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-stibp'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='amd-ssbd'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='rsba'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='require' name='pschange-mc-no'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='erms'/>
Oct 30 13:50:22 user nova-compute[74319]:       <feature policy='disable' name='xsaveopt'/>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:     <mode name='custom' supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>qemu64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>qemu32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>phenom</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>pentium</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>n270</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm64</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>kvm32</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>coreduo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>core2duo</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>athlon</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Westmere</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Snowridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Skylake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>SandyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Penryn</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G5</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G4</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G3</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Opteron_G2</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Opteron_G1</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>IvyBridge</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Icelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Haswell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Rome</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-Milan</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC-IBPB</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>EPYC</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Dhyana</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cooperlake</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>Conroe</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Cascadelake-Server</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-noTSX</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell-IBRS</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='no'>Broadwell</model>
Oct 30 13:50:22 user nova-compute[74319]:       <model usable='yes'>486</model>
Oct 30 13:50:22 user nova-compute[74319]:     </mode>
Oct 30 13:50:22 user nova-compute[74319]:   </cpu>
Oct 30 13:50:22 user nova-compute[74319]:   <memoryBacking supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:     <enum name='sourceType'>
Oct 30 13:50:22 user nova-compute[74319]:       <value>file</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>anonymous</value>
Oct 30 13:50:22 user nova-compute[74319]:       <value>memfd</value>
Oct 30 13:50:22 user nova-compute[74319]:     </enum>
Oct 30 13:50:22 user nova-compute[74319]:   </memoryBacking>
Oct 30 13:50:22 user nova-compute[74319]:   <devices>
Oct 30 13:50:22 user nova-compute[74319]:     <disk supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='diskDevice'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>disk</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cdrom</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>floppy</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>lun</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='bus'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>fdc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sata</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </disk>
Oct 30 13:50:22 user nova-compute[74319]:     <graphics supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='type'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>sdl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vnc</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>spice</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egl-headless</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </graphics>
Oct 30 13:50:22 user nova-compute[74319]:     <video supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='modelType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>cirrus</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>vmvga</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>qxl</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>none</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>bochs</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>ramfb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </video>
Oct 30 13:50:22 user nova-compute[74319]:     <hostdev supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='mode'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>subsystem</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='startupPolicy'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>default</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>mandatory</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>requisite</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>optional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='subsysType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>usb</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>pci</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>scsi</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='capsType'/>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='pciBackend'/>
Oct 30 13:50:22 user nova-compute[74319]:     </hostdev>
Oct 30 13:50:22 user nova-compute[74319]:     <rng supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtio-non-transitional</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>random</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>egd</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>builtin</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </rng>
Oct 30 13:50:22 user nova-compute[74319]:     <filesystem supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='driverType'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>path</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>handle</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>virtiofs</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </filesystem>
Oct 30 13:50:22 user nova-compute[74319]:     <tpm supported='yes'>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='model'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-tis</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>tpm-crb</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:       <enum name='backendModel'>
Oct 30 13:50:22 user nova-compute[74319]:         <value>passthrough</value>
Oct 30 13:50:22 user nova-compute[74319]:         <value>emulator</value>
Oct 30 13:50:22 user nova-compute[74319]:       </enum>
Oct 30 13:50:22 user nova-compute[74319]:     </tpm>
Oct 30 13:50:22 user nova-compute[74319]:   </devices>
Oct 30 13:50:22 user nova-compute[74319]:   <features>
Oct 30 13:50:22 user nova-compute[74319]:     <gic supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:     <vmcoreinfo supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <genid supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backingStoreInput supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <backup supported='yes'/>
Oct 30 13:50:22 user nova-compute[74319]:     <sev supported='no'/>
Oct 30 13:50:22 user nova-compute[74319]:   </features>
Oct 30 13:50:22 user nova-compute[74319]: </domainCapabilities>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74319) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Checking secure boot support for host arch (x86_64) {{(pid=74319) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Checking secure boot support for host arch (x86_64) {{(pid=74319) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Checking secure boot support for host arch (x86_64) {{(pid=74319) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Secure Boot support detected
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] cpu compare xml: <cpu match="exact">
Oct 30 13:50:22 user nova-compute[74319]:   <model>Nehalem</model>
Oct 30 13:50:22 user nova-compute[74319]: </cpu>
Oct 30 13:50:22 user nova-compute[74319]:  {{(pid=74319) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.virt.node [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Generated node identity 8f3b70bc-49f7-41d1-83ac-bc539bcc795e
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.virt.node [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Wrote node identity 8f3b70bc-49f7-41d1-83ac-bc539bcc795e to /opt/stack/data/nova/compute_id
Oct 30 13:50:22 user nova-compute[74319]: WARNING nova.compute.manager [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Compute nodes ['8f3b70bc-49f7-41d1-83ac-bc539bcc795e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.compute.manager [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 30 13:50:22 user nova-compute[74319]: WARNING nova.compute.manager [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 30 13:50:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:50:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:50:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Hypervisor/Node resource view: name=user free_ram=10978MB free_disk=26.225723266601562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:50:22 user nova-compute[74319]: WARNING nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] No compute node record for user:8f3b70bc-49f7-41d1-83ac-bc539bcc795e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8f3b70bc-49f7-41d1-83ac-bc539bcc795e could not be found.
Oct 30 13:50:22 user nova-compute[74319]: INFO nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Compute node record created for user:user with uuid: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:50:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:50:23 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] [req-e66f9bbf-4fcf-4c1e-a9d4-70996f106974] Created resource provider record via placement API for resource provider with UUID 8f3b70bc-49f7-41d1-83ac-bc539bcc795e and name user.
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74319) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 30 13:50:23 user nova-compute[74319]: INFO nova.virt.libvirt.host [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] kernel doesn't support AMD SEV
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Libvirt baseline CPU <cpu>
Oct 30 13:50:23 user nova-compute[74319]:   <arch>x86_64</arch>
Oct 30 13:50:23 user nova-compute[74319]:   <model>Nehalem</model>
Oct 30 13:50:23 user nova-compute[74319]:   <vendor>Intel</vendor>
Oct 30 13:50:23 user nova-compute[74319]:   <topology sockets="6" cores="1" threads="1"/>
Oct 30 13:50:23 user nova-compute[74319]: </cpu>
Oct 30 13:50:23 user nova-compute[74319]:  {{(pid=74319) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Updated inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Updating resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e generation from 0 to 1 during operation: update_inventory {{(pid=74319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Updating resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e generation from 1 to 2 during operation: update_traits {{(pid=74319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.631s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.service [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Creating RPC server for service compute {{(pid=74319) start /opt/stack/nova/nova/service.py:182}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.service [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] Join ServiceGroup membership for this service compute {{(pid=74319) start /opt/stack/nova/nova/service.py:199}}
Oct 30 13:50:23 user nova-compute[74319]: DEBUG nova.servicegroup.drivers.db [None req-1fa3b15e-78a1-4fc8-8c0d-57e632101eab None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74319) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 30 13:50:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:50:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:51:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:51:14 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:51:14 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=10404MB free_disk=26.12945556640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:51:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:52:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:52:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:52:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=10345MB free_disk=26.193572998046875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:52:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:52:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:53:14 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:53:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:53:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=25.94720458984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:53:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:53:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:53:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:53:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:53:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 13:53:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 13:54:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:15 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:54:16 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:16 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9600MB free_disk=25.967365264892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:54:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:54:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:54:18 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:54:18 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 13:54:18 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 13:54:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:33 user nova-compute[74319]: INFO nova.compute.claims [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Claim successful on node user
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:33 user nova-compute[74319]: INFO nova.compute.claims [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Claim successful on node user
Oct 30 13:54:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Creating image(s)
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.policy [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f860f101c5034c638821e668d33eeeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6fce9483d048b580da3d18df44316d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.part --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.virt.images [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] 6e84464e-b827-48f1-88b9-f2140e869651 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.part /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG nova.policy [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '48a1732c4db44f33a372ab2e8521b773', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '787db3f3dd724d9f9d5c61ade8682b35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.part /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.converted" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Creating image(s)
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "/opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "/opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "/opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.996s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:35 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe1valzx2/privsep.sock']
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.099s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:35 user sudo[83614]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe1valzx2/privsep.sock
Oct 30 13:54:35 user sudo[83614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 13:54:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Successfully created port: 21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:54:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Successfully created port: e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:54:36 user sudo[83614]: pam_unix(sudo:session): session closed for user root
Oct 30 13:54:36 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Spawned new privsep daemon via rootwrap
Oct 30 13:54:36 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 13:54:36 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 13:54:36 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 30 13:54:36 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83619
Oct 30 13:54:36 user nova-compute[74319]: WARNING oslo_privsep.priv_context [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] privsep daemon already running
Oct 30 13:54:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.165s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk 1073741824" returned: 0 in 0.051s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.227s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.223s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk 1073741824" returned: 0 in 0.053s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Cannot resize image /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Ensure instance console log exists: /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.237s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:54:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Cannot resize image /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Ensure instance console log exists: /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Successfully updated port: e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquired lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:38 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Successfully updated port: 21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquired lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-changed-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Refreshing instance network info cache due to event network-changed-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] Acquiring lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Releasing lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Instance network_info: |[{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] Acquired lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.neutron [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Refreshing network info cache for port e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Start _get_guest_xml network_info=[{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:54:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-307491263',display_name='tempest-ServerActionsTestOtherB-server-307491263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-307491263',id=2,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrzIEhweMKLwYJIjHXoHcltfLtDk8f0POK0GdiuUtbxBvnI/VYzVgSx5bTw7QrxQ7FcxBALaQBhI0X3rjhL11Fc1mAcBl/DB4NeU3XkhKF8PjhaWfffN62Ggq98UQ91dw==',key_name='tempest-keypair-272861040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='787db3f3dd724d9f9d5c61ade8682b35',ramdisk_id='',reservation_id='r-4x52z5lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-309973993',owner_user_name='tempest-ServerActionsTestOtherB-309973993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a1732c4db44f33a372ab2e8521b773',uuid=bb5d67f1-e3ef-41ae-94f1-29c29eb30388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converting VIF {"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lazy-loading 'pci_devices' on Instance uuid bb5d67f1-e3ef-41ae-94f1-29c29eb30388 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:54:40 user nova-compute[74319]:   <uuid>bb5d67f1-e3ef-41ae-94f1-29c29eb30388</uuid>
Oct 30 13:54:40 user nova-compute[74319]:   <name>instance-00000002</name>
Oct 30 13:54:40 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:54:40 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:54:40 user nova-compute[74319]:   <metadata>
Oct 30 13:54:40 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:54:40 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:name>tempest-ServerActionsTestOtherB-server-307491263</nova:name>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:54:40</nova:creationTime>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:54:40 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:owner>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:user uuid="48a1732c4db44f33a372ab2e8521b773">tempest-ServerActionsTestOtherB-309973993-project-member</nova:user>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:project uuid="787db3f3dd724d9f9d5c61ade8682b35">tempest-ServerActionsTestOtherB-309973993</nova:project>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:owner>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:ports>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:port uuid="e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1">
Oct 30 13:54:40 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 13:54:40 user nova-compute[74319]:         </nova:port>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:ports>
Oct 30 13:54:40 user nova-compute[74319]:     </nova:instance>
Oct 30 13:54:40 user nova-compute[74319]:   </metadata>
Oct 30 13:54:40 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:54:40 user nova-compute[74319]:     <system>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="serial">bb5d67f1-e3ef-41ae-94f1-29c29eb30388</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="uuid">bb5d67f1-e3ef-41ae-94f1-29c29eb30388</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:54:40 user nova-compute[74319]:     </system>
Oct 30 13:54:40 user nova-compute[74319]:   </sysinfo>
Oct 30 13:54:40 user nova-compute[74319]:   <os>
Oct 30 13:54:40 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:54:40 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:54:40 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:54:40 user nova-compute[74319]:   </os>
Oct 30 13:54:40 user nova-compute[74319]:   <features>
Oct 30 13:54:40 user nova-compute[74319]:     <acpi/>
Oct 30 13:54:40 user nova-compute[74319]:     <apic/>
Oct 30 13:54:40 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:54:40 user nova-compute[74319]:   </features>
Oct 30 13:54:40 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:54:40 user nova-compute[74319]:   </clock>
Oct 30 13:54:40 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:54:40 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:54:40 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:54:40 user nova-compute[74319]:   </cpu>
Oct 30 13:54:40 user nova-compute[74319]:   <devices>
Oct 30 13:54:40 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:54:40 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:54:40 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk"/>
Oct 30 13:54:40 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:     </disk>
Oct 30 13:54:40 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:54:40 user nova-compute[74319]:       <mac address="fa:16:3e:43:d7:b6"/>
Oct 30 13:54:40 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:54:40 user nova-compute[74319]:       <target dev="tape6e238f7-af"/>
Oct 30 13:54:40 user nova-compute[74319]:     </interface>
Oct 30 13:54:40 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:54:40 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/console.log" append="off"/>
Oct 30 13:54:40 user nova-compute[74319]:     </serial>
Oct 30 13:54:40 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:54:40 user nova-compute[74319]:     <video>
Oct 30 13:54:40 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:     </video>
Oct 30 13:54:40 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:54:40 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:54:40 user nova-compute[74319]:     </rng>
Oct 30 13:54:40 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:54:40 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:54:40 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:54:40 user nova-compute[74319]:     </memballoon>
Oct 30 13:54:40 user nova-compute[74319]:   </devices>
Oct 30 13:54:40 user nova-compute[74319]: </domain>
Oct 30 13:54:40 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-307491263',display_name='tempest-ServerActionsTestOtherB-server-307491263',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-307491263',id=2,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrzIEhweMKLwYJIjHXoHcltfLtDk8f0POK0GdiuUtbxBvnI/VYzVgSx5bTw7QrxQ7FcxBALaQBhI0X3rjhL11Fc1mAcBl/DB4NeU3XkhKF8PjhaWfffN62Ggq98UQ91dw==',key_name='tempest-keypair-272861040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='787db3f3dd724d9f9d5c61ade8682b35',ramdisk_id='',reservation_id='r-4x52z5lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-309973993',owner_user_name='tempest-ServerActionsTestOtherB-309973993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a1732c4db44f33a372ab2e8521b773',uuid=bb5d67f1-e3ef-41ae-94f1-29c29eb30388,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converting VIF {"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG os_vif [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Created schema index Interface.name {{(pid=74319) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Created schema index Port.name {{(pid=74319) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Created schema index Bridge.name {{(pid=74319) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.neutron [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating instance_info_cache with network_info: [{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [POLLOUT] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Releasing lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Instance network_info: |[{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Start _get_guest_xml network_info=[{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9aedfa2-540b-53ee-b011-c936142c55de', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:40 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprxhyps43/privsep.sock']
Oct 30 13:54:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:54:40 user sudo[83668]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprxhyps43/privsep.sock
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:54:40 user sudo[83668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-135573517',display_name='tempest-AttachVolumeNegativeTest-server-135573517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-135573517',id=1,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIsYKJlH54QpTcOGIS93Qht181N+yaK1+aS/FMt+hxcBk7r+YY567Iv1V+n9K4dzT7cLwfXOpFTn4ZAMYUHVhFr1kt+EajOkO3tBjqqtWwMKkPLJalkveYA6po9TVE4Ag==',key_name='tempest-keypair-1652306217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-pqxuo1qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=4b25c9fe-a007-432e-b3a0-9b0df509b33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:54:40 user nova-compute[74319]:   <uuid>4b25c9fe-a007-432e-b3a0-9b0df509b33b</uuid>
Oct 30 13:54:40 user nova-compute[74319]:   <name>instance-00000001</name>
Oct 30 13:54:40 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:54:40 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:54:40 user nova-compute[74319]:   <metadata>
Oct 30 13:54:40 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:54:40 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-135573517</nova:name>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:54:40</nova:creationTime>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:54:40 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:owner>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:user uuid="f860f101c5034c638821e668d33eeeff">tempest-AttachVolumeNegativeTest-1763755820-project-member</nova:user>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:project uuid="ee6fce9483d048b580da3d18df44316d">tempest-AttachVolumeNegativeTest-1763755820</nova:project>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:owner>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:54:40 user nova-compute[74319]:       <nova:ports>
Oct 30 13:54:40 user nova-compute[74319]:         <nova:port uuid="21dcf81b-73bc-43c1-a5b4-e93c62d76925">
Oct 30 13:54:40 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 13:54:40 user nova-compute[74319]:         </nova:port>
Oct 30 13:54:40 user nova-compute[74319]:       </nova:ports>
Oct 30 13:54:40 user nova-compute[74319]:     </nova:instance>
Oct 30 13:54:40 user nova-compute[74319]:   </metadata>
Oct 30 13:54:40 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:54:40 user nova-compute[74319]:     <system>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="serial">4b25c9fe-a007-432e-b3a0-9b0df509b33b</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="uuid">4b25c9fe-a007-432e-b3a0-9b0df509b33b</entry>
Oct 30 13:54:40 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:54:40 user nova-compute[74319]:     </system>
Oct 30 13:54:40 user nova-compute[74319]:   </sysinfo>
Oct 30 13:54:40 user nova-compute[74319]:   <os>
Oct 30 13:54:40 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:54:40 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:54:40 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:54:40 user nova-compute[74319]:   </os>
Oct 30 13:54:40 user nova-compute[74319]:   <features>
Oct 30 13:54:40 user nova-compute[74319]:     <acpi/>
Oct 30 13:54:40 user nova-compute[74319]:     <apic/>
Oct 30 13:54:40 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:54:40 user nova-compute[74319]:   </features>
Oct 30 13:54:40 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:54:40 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:54:40 user nova-compute[74319]:   </clock>
Oct 30 13:54:40 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:54:40 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:54:40 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:54:40 user nova-compute[74319]:   </cpu>
Oct 30 13:54:40 user nova-compute[74319]:   <devices>
Oct 30 13:54:40 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:54:40 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:54:40 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk"/>
Oct 30 13:54:40 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:     </disk>
Oct 30 13:54:40 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:54:40 user nova-compute[74319]:       <mac address="fa:16:3e:df:ad:0d"/>
Oct 30 13:54:40 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:54:40 user nova-compute[74319]:       <target dev="tap21dcf81b-73"/>
Oct 30 13:54:40 user nova-compute[74319]:     </interface>
Oct 30 13:54:40 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:54:40 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/console.log" append="off"/>
Oct 30 13:54:40 user nova-compute[74319]:     </serial>
Oct 30 13:54:40 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:54:40 user nova-compute[74319]:     <video>
Oct 30 13:54:40 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:40 user nova-compute[74319]:     </video>
Oct 30 13:54:40 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:54:40 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:54:40 user nova-compute[74319]:     </rng>
Oct 30 13:54:40 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:54:40 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:54:40 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:54:40 user nova-compute[74319]:     </memballoon>
Oct 30 13:54:40 user nova-compute[74319]:   </devices>
Oct 30 13:54:40 user nova-compute[74319]: </domain>
Oct 30 13:54:40 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-135573517',display_name='tempest-AttachVolumeNegativeTest-server-135573517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-135573517',id=1,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIsYKJlH54QpTcOGIS93Qht181N+yaK1+aS/FMt+hxcBk7r+YY567Iv1V+n9K4dzT7cLwfXOpFTn4ZAMYUHVhFr1kt+EajOkO3tBjqqtWwMKkPLJalkveYA6po9TVE4Ag==',key_name='tempest-keypair-1652306217',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-pqxuo1qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=4b25c9fe-a007-432e-b3a0-9b0df509b33b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG os_vif [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '65d3b8f1-c8c0-5d18-93ec-4611a9a3e333', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-changed-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Refreshing instance network info cache due to event network-changed-21dcf81b-73bc-43c1-a5b4-e93c62d76925. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:54:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] Acquiring lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] Acquired lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Refreshing network info cache for port 21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updated VIF entry in instance network info cache for port e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28876cf9-6dea-4841-a2ac-743d57b9cb5f req-dc79be19-c341-4f99-a28b-2acf3c6d57e6 service nova] Releasing lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:42 user sudo[83668]: pam_unix(sudo:session): session closed for user root
Oct 30 13:54:42 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Spawned new privsep daemon via rootwrap
Oct 30 13:54:42 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 13:54:42 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 13:54:42 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 30 13:54:42 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83673
Oct 30 13:54:42 user nova-compute[74319]: WARNING oslo_privsep.priv_context [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] privsep daemon already running
Oct 30 13:54:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updated VIF entry in instance network info cache for port 21dcf81b-73bc-43c1-a5b4-e93c62d76925. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating instance_info_cache with network_info: [{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8dd0240f-5079-4af6-b79c-52aabf057d57 req-14d5fda6-da97-473f-a51e-89715ae6262b service nova] Releasing lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21dcf81b-73, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21dcf81b-73, col_values=(('qos', UUID('df898359-b685-4e81-b6bd-83be6d82ccf4')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21dcf81b-73, col_values=(('external_ids', {'iface-id': '21dcf81b-73bc-43c1-a5b4-e93c62d76925', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ad:0d', 'vm-uuid': '4b25c9fe-a007-432e-b3a0-9b0df509b33b'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape6e238f7-af, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape6e238f7-af, col_values=(('qos', UUID('8ade02fe-bbe0-4d38-bcde-b7d38832fded')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape6e238f7-af, col_values=(('external_ids', {'iface-id': 'e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:d7:b6', 'vm-uuid': 'bb5d67f1-e3ef-41ae-94f1-29c29eb30388'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:43 user nova-compute[74319]: INFO os_vif [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73')
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:43 user nova-compute[74319]: INFO os_vif [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af')
Oct 30 13:54:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:df:ad:0d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] No VIF found with MAC fa:16:3e:43:d7:b6, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Instance spawned successfully.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Instance spawned successfully.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Took 14.15 seconds to spawn the instance on the hypervisor.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Took 13.37 seconds to spawn the instance on the hypervisor.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.compute.manager [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Took 15.31 seconds to build instance.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-85806052-f6d7-4da1-8fbc-b7687773bb05 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.659s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:48 user nova-compute[74319]: INFO nova.compute.manager [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Took 14.87 seconds to build instance.
Oct 30 13:54:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8cdceedf-72a9-4028-9958-e75110a15cf0 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.068s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:49 user nova-compute[74319]: INFO nova.compute.claims [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Claim successful on node user
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.084s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:49 user nova-compute[74319]: INFO nova.compute.claims [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Claim successful on node user
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:49 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.policy [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ef82049505dc43df9f616141bddb264d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de628f0340944bfcabf684a26d036d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Creating image(s)
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.902s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:50 user nova-compute[74319]: INFO nova.compute.claims [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Claim successful on node user
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.part --force-share --output=json" returned: 0 in 0.251s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.virt.images [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] a4779bca-25e1-403c-aba1-ab476117ee56 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 13:54:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.part /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Creating image(s)
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "/opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "/opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.part /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.converted" returned: 0 in 0.328s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.policy [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca76c949d242412ebc0bcedc358857a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ad088e24dd644c29c48c1e4222ad186', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Successfully created port: 39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.compute.manager [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.compute.manager [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] No waiting events found dispatching network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:54:51 user nova-compute[74319]: WARNING nova.compute.manager [req-6f758f53-04b1-4b29-a28c-4be79907f7b9 req-aaa36cba-11b3-4738-9714-f71a4a4755bb service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received unexpected event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 for instance with vm_state active and task_state None.
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.313s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe.converted --force-share --output=json" returned: 0 in 0.375s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.289s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk 1073741824" returned: 0 in 0.079s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json" returned: 0 in 0.277s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:52 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.289s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json" returned: 0 in 0.301s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe,backing_fmt=raw /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe,backing_fmt=raw /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk 1073741824" returned: 0 in 0.074s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "9a04b0c961807ecbe8d80f99ad420896f7519afe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.382s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:52 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Creating image(s)
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "/opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "/opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Cannot resize image /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Ensure instance console log exists: /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.policy [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6515419e258d4c978180f0a2fec90ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966fa806de14afa86ce28be485ef471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe --force-share --output=json" returned: 0 in 0.248s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Successfully updated port: 39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquired lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.316s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-changed-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Refreshing instance network info cache due to event network-changed-39585cd9-befe-421d-a47c-67a5f53e096c. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] Acquiring lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Cannot resize image /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Ensure instance console log exists: /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.225s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Successfully created port: 90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk 1073741824" returned: 0 in 0.065s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.251s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating instance_info_cache with network_info: [{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Releasing lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Instance network_info: |[{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] Acquired lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.neutron [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Refreshing network info cache for port 39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Start _get_guest_xml network_info=[{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:54:41Z,direct_url=<?>,disk_format='qcow2',id=a4779bca-25e1-403c-aba1-ab476117ee56,min_disk=0,min_ram=0,name='',owner='fec2492980844822b408f1544c5900b4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:54:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a4779bca-25e1-403c-aba1-ab476117ee56'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:54:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Cannot resize image /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Ensure instance console log exists: /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:54:41Z,direct_url=<?>,disk_format='qcow2',id=a4779bca-25e1-403c-aba1-ab476117ee56,min_disk=0,min_ram=0,name='',owner='fec2492980844822b408f1544c5900b4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:54:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1479074865',display_name='tempest-AttachSCSIVolumeTestJSON-server-1479074865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1479074865',id=3,image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDJoszXKHP6k4TsOB9r9QswAZmNJi7DyOXenwX8SzUkYb5y2BvG1Xh1Z8Qc/+odgq4xYrhrQVSlYDLhV8h5AZErU+6x7fH8LSVwVBX5cl7+sGtMVkHo3e1ZJSTvvKMaew==',key_name='tempest-keypair-731347147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de628f0340944bfcabf684a26d036d5f',ramdisk_id='',reservation_id='r-8t49tgyr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-919970527',owner_user_name='tempest-AttachSCSIVolumeTestJSON-919970527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef82049505dc43df9f616141bddb264d',uuid=4a623a60-8c92-4860-92a0-57b606be809a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converting VIF {"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] No waiting events found dispatching network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:54:53 user nova-compute[74319]: WARNING nova.compute.manager [req-92cf035f-d447-4378-8efa-ca39df464ed4 req-e4c5fe96-e354-4762-89b7-ba6b03bf93a4 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received unexpected event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 for instance with vm_state active and task_state None.
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:54:53 user nova-compute[74319]:   <uuid>4a623a60-8c92-4860-92a0-57b606be809a</uuid>
Oct 30 13:54:53 user nova-compute[74319]:   <name>instance-00000003</name>
Oct 30 13:54:53 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:54:53 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:54:53 user nova-compute[74319]:   <metadata>
Oct 30 13:54:53 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:54:53 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1479074865</nova:name>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:54:53</nova:creationTime>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:54:53 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:54:53 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:owner>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:user uuid="ef82049505dc43df9f616141bddb264d">tempest-AttachSCSIVolumeTestJSON-919970527-project-member</nova:user>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:project uuid="de628f0340944bfcabf684a26d036d5f">tempest-AttachSCSIVolumeTestJSON-919970527</nova:project>
Oct 30 13:54:53 user nova-compute[74319]:       </nova:owner>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:root type="image" uuid="a4779bca-25e1-403c-aba1-ab476117ee56"/>
Oct 30 13:54:53 user nova-compute[74319]:       <nova:ports>
Oct 30 13:54:53 user nova-compute[74319]:         <nova:port uuid="39585cd9-befe-421d-a47c-67a5f53e096c">
Oct 30 13:54:53 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 13:54:53 user nova-compute[74319]:         </nova:port>
Oct 30 13:54:53 user nova-compute[74319]:       </nova:ports>
Oct 30 13:54:53 user nova-compute[74319]:     </nova:instance>
Oct 30 13:54:53 user nova-compute[74319]:   </metadata>
Oct 30 13:54:53 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:54:53 user nova-compute[74319]:     <system>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="serial">4a623a60-8c92-4860-92a0-57b606be809a</entry>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="uuid">4a623a60-8c92-4860-92a0-57b606be809a</entry>
Oct 30 13:54:53 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:54:53 user nova-compute[74319]:     </system>
Oct 30 13:54:53 user nova-compute[74319]:   </sysinfo>
Oct 30 13:54:53 user nova-compute[74319]:   <os>
Oct 30 13:54:53 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:54:53 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:54:53 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:54:53 user nova-compute[74319]:   </os>
Oct 30 13:54:53 user nova-compute[74319]:   <features>
Oct 30 13:54:53 user nova-compute[74319]:     <acpi/>
Oct 30 13:54:53 user nova-compute[74319]:     <apic/>
Oct 30 13:54:53 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:54:53 user nova-compute[74319]:   </features>
Oct 30 13:54:53 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:54:53 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:54:53 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:54:53 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:54:53 user nova-compute[74319]:   </clock>
Oct 30 13:54:53 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:54:53 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:54:53 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:54:53 user nova-compute[74319]:   </cpu>
Oct 30 13:54:53 user nova-compute[74319]:   <devices>
Oct 30 13:54:53 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:54:53 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:54:53 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk"/>
Oct 30 13:54:53 user nova-compute[74319]:       <target dev="sda" bus="scsi"/>
Oct 30 13:54:53 user nova-compute[74319]:       <address type="drive" controller="0" unit="0"/>
Oct 30 13:54:53 user nova-compute[74319]:     </disk>
Oct 30 13:54:53 user nova-compute[74319]:     <disk type="file" device="cdrom">
Oct 30 13:54:53 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 13:54:53 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.config"/>
Oct 30 13:54:53 user nova-compute[74319]:       <target dev="sdb" bus="scsi"/>
Oct 30 13:54:53 user nova-compute[74319]:       <address type="drive" controller="0" unit="1"/>
Oct 30 13:54:53 user nova-compute[74319]:     </disk>
Oct 30 13:54:53 user nova-compute[74319]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 30 13:54:53 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:54:53 user nova-compute[74319]:       <mac address="fa:16:3e:77:12:ff"/>
Oct 30 13:54:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:53 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:54:53 user nova-compute[74319]:       <target dev="tap39585cd9-be"/>
Oct 30 13:54:53 user nova-compute[74319]:     </interface>
Oct 30 13:54:53 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:54:53 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/console.log" append="off"/>
Oct 30 13:54:53 user nova-compute[74319]:     </serial>
Oct 30 13:54:53 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:54:53 user nova-compute[74319]:     <video>
Oct 30 13:54:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:53 user nova-compute[74319]:     </video>
Oct 30 13:54:53 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:54:53 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:54:53 user nova-compute[74319]:     </rng>
Oct 30 13:54:53 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:54:53 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:54:53 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:54:53 user nova-compute[74319]:     </memballoon>
Oct 30 13:54:53 user nova-compute[74319]:   </devices>
Oct 30 13:54:53 user nova-compute[74319]: </domain>
Oct 30 13:54:53 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1479074865',display_name='tempest-AttachSCSIVolumeTestJSON-server-1479074865',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1479074865',id=3,image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDJoszXKHP6k4TsOB9r9QswAZmNJi7DyOXenwX8SzUkYb5y2BvG1Xh1Z8Qc/+odgq4xYrhrQVSlYDLhV8h5AZErU+6x7fH8LSVwVBX5cl7+sGtMVkHo3e1ZJSTvvKMaew==',key_name='tempest-keypair-731347147',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de628f0340944bfcabf684a26d036d5f',ramdisk_id='',reservation_id='r-8t49tgyr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-919970527',owner_user_name='tempest-AttachSCSIVolumeTestJSON-919970527-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef82049505dc43df9f616141bddb264d',uuid=4a623a60-8c92-4860-92a0-57b606be809a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converting VIF {"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG os_vif [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b4ee34-094c-5a17-90be-29c6f39a29f1', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39585cd9-be, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39585cd9-be, col_values=(('qos', UUID('d1e1d4c2-760e-4ff4-9f01-aad9318aa186')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39585cd9-be, col_values=(('external_ids', {'iface-id': '39585cd9-befe-421d-a47c-67a5f53e096c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:12:ff', 'vm-uuid': '4a623a60-8c92-4860-92a0-57b606be809a'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:53 user nova-compute[74319]: INFO os_vif [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be')
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No BDM found with device name sda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No VIF found with MAC fa:16:3e:77:12:ff, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:54:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Using config drive
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Successfully created port: 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Creating config drive at /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.config
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplbr4z_l9 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplbr4z_l9" returned: 0 in 0.066s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updated VIF entry in instance network info cache for port 39585cd9-befe-421d-a47c-67a5f53e096c. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating instance_info_cache with network_info: [{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94d949a2-531e-4fe2-9bf8-fda6074a49e6 req-782c3caf-fa1e-4a47-b6a1-04661e047366 service nova] Releasing lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Successfully updated port: 90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquired lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-changed-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Refreshing instance network info cache due to event network-changed-90db37ff-95ac-4232-9116-f20a7ab74a27. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:54:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] Acquiring lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating instance_info_cache with network_info: [{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Successfully updated port: 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Releasing lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Instance network_info: |[{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] Acquired lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Refreshing network info cache for port 90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Start _get_guest_xml network_info=[{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquired lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:54:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847837838',display_name='tempest-TestVolumeSwap-server-847837838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847837838',id=4,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLstNsD34LDlNlwy7g8gtxr2IQeYjZCHoipO/ZQuTb29rwBG4Nx/Tohzl610+1ffGXELlkcn3bGQ5pptM2ypYvN+0aHAHz3+OiTiQUyrIHihxlVcb/OsFNALR6HTz4pxPw==',key_name='tempest-keypair-2139898388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad088e24dd644c29c48c1e4222ad186',ramdisk_id='',reservation_id='r-egy0kk4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-207996520',owner_user_name='tempest-TestVolumeSwap-207996520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca76c949d242412ebc0bcedc358857a5',uuid=1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converting VIF {"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.objects.instance [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:54:55 user nova-compute[74319]:   <uuid>1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4</uuid>
Oct 30 13:54:55 user nova-compute[74319]:   <name>instance-00000004</name>
Oct 30 13:54:55 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:54:55 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:54:55 user nova-compute[74319]:   <metadata>
Oct 30 13:54:55 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:54:55 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:name>tempest-TestVolumeSwap-server-847837838</nova:name>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:54:55</nova:creationTime>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:54:55 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:54:55 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:owner>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:user uuid="ca76c949d242412ebc0bcedc358857a5">tempest-TestVolumeSwap-207996520-project-member</nova:user>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:project uuid="4ad088e24dd644c29c48c1e4222ad186">tempest-TestVolumeSwap-207996520</nova:project>
Oct 30 13:54:55 user nova-compute[74319]:       </nova:owner>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:54:55 user nova-compute[74319]:       <nova:ports>
Oct 30 13:54:55 user nova-compute[74319]:         <nova:port uuid="90db37ff-95ac-4232-9116-f20a7ab74a27">
Oct 30 13:54:55 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 13:54:55 user nova-compute[74319]:         </nova:port>
Oct 30 13:54:55 user nova-compute[74319]:       </nova:ports>
Oct 30 13:54:55 user nova-compute[74319]:     </nova:instance>
Oct 30 13:54:55 user nova-compute[74319]:   </metadata>
Oct 30 13:54:55 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:54:55 user nova-compute[74319]:     <system>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="serial">1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4</entry>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="uuid">1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4</entry>
Oct 30 13:54:55 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:54:55 user nova-compute[74319]:     </system>
Oct 30 13:54:55 user nova-compute[74319]:   </sysinfo>
Oct 30 13:54:55 user nova-compute[74319]:   <os>
Oct 30 13:54:55 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:54:55 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:54:55 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:54:55 user nova-compute[74319]:   </os>
Oct 30 13:54:55 user nova-compute[74319]:   <features>
Oct 30 13:54:55 user nova-compute[74319]:     <acpi/>
Oct 30 13:54:55 user nova-compute[74319]:     <apic/>
Oct 30 13:54:55 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:54:55 user nova-compute[74319]:   </features>
Oct 30 13:54:55 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:54:55 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:54:55 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:54:55 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:54:55 user nova-compute[74319]:   </clock>
Oct 30 13:54:55 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:54:55 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:54:55 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:54:55 user nova-compute[74319]:   </cpu>
Oct 30 13:54:55 user nova-compute[74319]:   <devices>
Oct 30 13:54:55 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:54:55 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:54:55 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk"/>
Oct 30 13:54:55 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:54:55 user nova-compute[74319]:     </disk>
Oct 30 13:54:55 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:54:55 user nova-compute[74319]:       <mac address="fa:16:3e:4a:db:68"/>
Oct 30 13:54:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:55 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:54:55 user nova-compute[74319]:       <target dev="tap90db37ff-95"/>
Oct 30 13:54:55 user nova-compute[74319]:     </interface>
Oct 30 13:54:55 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:54:55 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/console.log" append="off"/>
Oct 30 13:54:55 user nova-compute[74319]:     </serial>
Oct 30 13:54:55 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:54:55 user nova-compute[74319]:     <video>
Oct 30 13:54:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:55 user nova-compute[74319]:     </video>
Oct 30 13:54:55 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:54:55 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:54:55 user nova-compute[74319]:     </rng>
Oct 30 13:54:55 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:54:55 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:54:55 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:54:55 user nova-compute[74319]:     </memballoon>
Oct 30 13:54:55 user nova-compute[74319]:   </devices>
Oct 30 13:54:55 user nova-compute[74319]: </domain>
Oct 30 13:54:55 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847837838',display_name='tempest-TestVolumeSwap-server-847837838',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847837838',id=4,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLstNsD34LDlNlwy7g8gtxr2IQeYjZCHoipO/ZQuTb29rwBG4Nx/Tohzl610+1ffGXELlkcn3bGQ5pptM2ypYvN+0aHAHz3+OiTiQUyrIHihxlVcb/OsFNALR6HTz4pxPw==',key_name='tempest-keypair-2139898388',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ad088e24dd644c29c48c1e4222ad186',ramdisk_id='',reservation_id='r-egy0kk4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-207996520',owner_user_name='tempest-TestVolumeSwap-207996520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca76c949d242412ebc0bcedc358857a5',uuid=1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converting VIF {"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG os_vif [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca9fb858-f6ac-5ddc-93c8-8bf54cff0471', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90db37ff-95, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap90db37ff-95, col_values=(('qos', UUID('f71b1d3f-10e8-4d74-a025-d4902576f16d')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap90db37ff-95, col_values=(('external_ids', {'iface-id': '90db37ff-95ac-4232-9116-f20a7ab74a27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:db:68', 'vm-uuid': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:55 user nova-compute[74319]: INFO os_vif [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95')
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] No VIF found with MAC fa:16:3e:4a:db:68, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-changed-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Refreshing instance network info cache due to event network-changed-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:54:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] Acquiring lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Releasing lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Instance network_info: |[{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] Acquired lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Refreshing network info cache for port 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Start _get_guest_xml network_info=[{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:54:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updated VIF entry in instance network info cache for port 90db37ff-95ac-4232-9116-f20a7ab74a27. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating instance_info_cache with network_info: [{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1575253195',display_name='tempest-VolumesAdminNegativeTest-server-1575253195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1575253195',id=5,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4BBWjV1G8wXg0I+oEnW4tFtRIQp+lKG+yBcz1dwBU8h8Mf2TGcedJclj5wqGl7I+SH5sD2x/dzH6deiNB/ffPMqbboYAs8PS/d+Hak+mIkHvv1dnVOFK1MIYyg7c7pQ==',key_name='tempest-keypair-256678168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-8dmymslh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6515419e258d4c978180f0a2fec90ecc',uuid=cb0d74e0-4263-4ee2-9db1-1615dd7efa24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'pci_devices' on Instance uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a5a90a5-93e0-499e-8d69-a260df166eea req-804d392d-52c0-4843-af00-14bcf53b6beb service nova] Releasing lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:54:56 user nova-compute[74319]:   <uuid>cb0d74e0-4263-4ee2-9db1-1615dd7efa24</uuid>
Oct 30 13:54:56 user nova-compute[74319]:   <name>instance-00000005</name>
Oct 30 13:54:56 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:54:56 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:54:56 user nova-compute[74319]:   <metadata>
Oct 30 13:54:56 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:54:56 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1575253195</nova:name>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:54:56</nova:creationTime>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:54:56 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:54:56 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:owner>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:user uuid="6515419e258d4c978180f0a2fec90ecc">tempest-VolumesAdminNegativeTest-487685260-project-member</nova:user>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:project uuid="1966fa806de14afa86ce28be485ef471">tempest-VolumesAdminNegativeTest-487685260</nova:project>
Oct 30 13:54:56 user nova-compute[74319]:       </nova:owner>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:54:56 user nova-compute[74319]:       <nova:ports>
Oct 30 13:54:56 user nova-compute[74319]:         <nova:port uuid="0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d">
Oct 30 13:54:56 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 13:54:56 user nova-compute[74319]:         </nova:port>
Oct 30 13:54:56 user nova-compute[74319]:       </nova:ports>
Oct 30 13:54:56 user nova-compute[74319]:     </nova:instance>
Oct 30 13:54:56 user nova-compute[74319]:   </metadata>
Oct 30 13:54:56 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:54:56 user nova-compute[74319]:     <system>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="serial">cb0d74e0-4263-4ee2-9db1-1615dd7efa24</entry>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="uuid">cb0d74e0-4263-4ee2-9db1-1615dd7efa24</entry>
Oct 30 13:54:56 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:54:56 user nova-compute[74319]:     </system>
Oct 30 13:54:56 user nova-compute[74319]:   </sysinfo>
Oct 30 13:54:56 user nova-compute[74319]:   <os>
Oct 30 13:54:56 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:54:56 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:54:56 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:54:56 user nova-compute[74319]:   </os>
Oct 30 13:54:56 user nova-compute[74319]:   <features>
Oct 30 13:54:56 user nova-compute[74319]:     <acpi/>
Oct 30 13:54:56 user nova-compute[74319]:     <apic/>
Oct 30 13:54:56 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:54:56 user nova-compute[74319]:   </features>
Oct 30 13:54:56 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:54:56 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:54:56 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:54:56 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:54:56 user nova-compute[74319]:   </clock>
Oct 30 13:54:56 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:54:56 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:54:56 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:54:56 user nova-compute[74319]:   </cpu>
Oct 30 13:54:56 user nova-compute[74319]:   <devices>
Oct 30 13:54:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:54:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:54:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk"/>
Oct 30 13:54:56 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:54:56 user nova-compute[74319]:     </disk>
Oct 30 13:54:56 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:54:56 user nova-compute[74319]:       <mac address="fa:16:3e:da:1b:13"/>
Oct 30 13:54:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:56 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:54:56 user nova-compute[74319]:       <target dev="tap0d13f00a-da"/>
Oct 30 13:54:56 user nova-compute[74319]:     </interface>
Oct 30 13:54:56 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:54:56 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/console.log" append="off"/>
Oct 30 13:54:56 user nova-compute[74319]:     </serial>
Oct 30 13:54:56 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:54:56 user nova-compute[74319]:     <video>
Oct 30 13:54:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:54:56 user nova-compute[74319]:     </video>
Oct 30 13:54:56 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:54:56 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:54:56 user nova-compute[74319]:     </rng>
Oct 30 13:54:56 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:54:56 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:54:56 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:54:56 user nova-compute[74319]:     </memballoon>
Oct 30 13:54:56 user nova-compute[74319]:   </devices>
Oct 30 13:54:56 user nova-compute[74319]: </domain>
Oct 30 13:54:56 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1575253195',display_name='tempest-VolumesAdminNegativeTest-server-1575253195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1575253195',id=5,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4BBWjV1G8wXg0I+oEnW4tFtRIQp+lKG+yBcz1dwBU8h8Mf2TGcedJclj5wqGl7I+SH5sD2x/dzH6deiNB/ffPMqbboYAs8PS/d+Hak+mIkHvv1dnVOFK1MIYyg7c7pQ==',key_name='tempest-keypair-256678168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-8dmymslh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6515419e258d4c978180f0a2fec90ecc',uuid=cb0d74e0-4263-4ee2-9db1-1615dd7efa24,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG os_vif [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae54143b-087c-5922-ac07-6d684b29e395', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d13f00a-da, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d13f00a-da, col_values=(('qos', UUID('286991a3-d226-4fc0-a2ca-77084b770e5e')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d13f00a-da, col_values=(('external_ids', {'iface-id': '0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:1b:13', 'vm-uuid': 'cb0d74e0-4263-4ee2-9db1-1615dd7efa24'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: INFO os_vif [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da')
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No VIF found with MAC fa:16:3e:da:1b:13, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:57 user nova-compute[74319]: DEBUG nova.network.neutron [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updated VIF entry in instance network info cache for port 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:54:57 user nova-compute[74319]: DEBUG nova.network.neutron [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:54:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35cc786e-dfde-4aec-8c39-66a965192b3f req-42b31453-cc58-405d-af6f-f42e7ba823fb service nova] Releasing lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:54:58 user nova-compute[74319]: INFO nova.compute.claims [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Claim successful on node user
Oct 30 13:54:58 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:54:58 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:54:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.policy [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be414360ec564f668e2b0704981a231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9adc75880c451b9ec528bcb47ca8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:54:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Creating image(s)
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.021s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] No waiting events found dispatching network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:54:59 user nova-compute[74319]: WARNING nova.compute.manager [req-3eb05794-e74a-470e-a472-fe10781f53fd req-978d348d-a050-4e3d-8855-fd7c74005249 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received unexpected event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d for instance with vm_state building and task_state spawning.
Oct 30 13:54:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.216s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk 1073741824" returned: 0 in 0.067s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:54:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.274s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Cannot resize image /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Ensure instance console log exists: /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Successfully created port: 007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Instance spawned successfully.
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:55:01 user nova-compute[74319]: INFO nova.compute.claims [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Claim successful on node user
Oct 30 13:55:01 user nova-compute[74319]: INFO nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Took 11.01 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:01 user nova-compute[74319]: INFO nova.compute.manager [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Took 12.03 seconds to build instance.
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c57fa683-8739-428c-9039-406741cb8908 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.277s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] No waiting events found dispatching network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:01 user nova-compute[74319]: WARNING nova.compute.manager [req-b509bbe3-9c99-4107-a5d8-397a0c824ec5 req-c1a2f1ff-db36-42c9-9244-ae89051c4c50 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received unexpected event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d for instance with vm_state building and task_state spawning.
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:55:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.policy [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '17e2ebdb640849858c5d396beac1d882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57c8b19c853e4f7c9f004133687b7638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:55:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Successfully updated port: 007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-changed-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing instance network info cache due to event network-changed-007cce73-5719-4d78-a8ee-eb979da7f5a6. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:55:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Creating image(s)
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "/opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "/opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.220s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.250s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk 1073741824" returned: 0 in 0.092s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Instance network_info: |[{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.neutron [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing network info cache for port 007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Start _get_guest_xml network_info=[{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:55:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Instance spawned successfully.
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Instance spawned successfully.
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.objects.instance [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'pci_devices' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.325s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:55:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Successfully created port: 4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Took 10.60 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:55:03 user nova-compute[74319]:   <uuid>279dca02-f5a2-44cb-9c37-3802a64e7901</uuid>
Oct 30 13:55:03 user nova-compute[74319]:   <name>instance-00000006</name>
Oct 30 13:55:03 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:55:03 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:55:03 user nova-compute[74319]:   <metadata>
Oct 30 13:55:03 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:55:03 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:55:02</nova:creationTime>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:55:03 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:55:03 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:owner>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:55:03 user nova-compute[74319]:       </nova:owner>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:55:03 user nova-compute[74319]:       <nova:ports>
Oct 30 13:55:03 user nova-compute[74319]:         <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:55:03 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:55:03 user nova-compute[74319]:         </nova:port>
Oct 30 13:55:03 user nova-compute[74319]:       </nova:ports>
Oct 30 13:55:03 user nova-compute[74319]:     </nova:instance>
Oct 30 13:55:03 user nova-compute[74319]:   </metadata>
Oct 30 13:55:03 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:55:03 user nova-compute[74319]:     <system>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="serial">279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="uuid">279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:55:03 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:55:03 user nova-compute[74319]:     </system>
Oct 30 13:55:03 user nova-compute[74319]:   </sysinfo>
Oct 30 13:55:03 user nova-compute[74319]:   <os>
Oct 30 13:55:03 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:55:03 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:55:03 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:55:03 user nova-compute[74319]:   </os>
Oct 30 13:55:03 user nova-compute[74319]:   <features>
Oct 30 13:55:03 user nova-compute[74319]:     <acpi/>
Oct 30 13:55:03 user nova-compute[74319]:     <apic/>
Oct 30 13:55:03 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:55:03 user nova-compute[74319]:   </features>
Oct 30 13:55:03 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:55:03 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:55:03 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:55:03 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:55:03 user nova-compute[74319]:   </clock>
Oct 30 13:55:03 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:55:03 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:55:03 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:55:03 user nova-compute[74319]:   </cpu>
Oct 30 13:55:03 user nova-compute[74319]:   <devices>
Oct 30 13:55:03 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:55:03 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:55:03 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk"/>
Oct 30 13:55:03 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:55:03 user nova-compute[74319]:     </disk>
Oct 30 13:55:03 user nova-compute[74319]:     <disk type="file" device="cdrom">
Oct 30 13:55:03 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 13:55:03 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config"/>
Oct 30 13:55:03 user nova-compute[74319]:       <target dev="hda" bus="ide"/>
Oct 30 13:55:03 user nova-compute[74319]:     </disk>
Oct 30 13:55:03 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:55:03 user nova-compute[74319]:       <mac address="fa:16:3e:ea:e3:d4"/>
Oct 30 13:55:03 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:03 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:55:03 user nova-compute[74319]:       <target dev="tap007cce73-57"/>
Oct 30 13:55:03 user nova-compute[74319]:     </interface>
Oct 30 13:55:03 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:55:03 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log" append="off"/>
Oct 30 13:55:03 user nova-compute[74319]:     </serial>
Oct 30 13:55:03 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:55:03 user nova-compute[74319]:     <video>
Oct 30 13:55:03 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:03 user nova-compute[74319]:     </video>
Oct 30 13:55:03 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:55:03 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:55:03 user nova-compute[74319]:     </rng>
Oct 30 13:55:03 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:55:03 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:55:03 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:55:03 user nova-compute[74319]:     </memballoon>
Oct 30 13:55:03 user nova-compute[74319]:   </devices>
Oct 30 13:55:03 user nova-compute[74319]: </domain>
Oct 30 13:55:03 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG os_vif [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Took 11.94 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e13ea83f-42b3-5014-906e-b0202f8ffbc7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap007cce73-57, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap007cce73-57, col_values=(('qos', UUID('4b327fe5-401b-4120-aef2-2717a8d51bcf')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap007cce73-57, col_values=(('external_ids', {'iface-id': '007cce73-5719-4d78-a8ee-eb979da7f5a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e3:d4', 'vm-uuid': '279dca02-f5a2-44cb-9c37-3802a64e7901'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Cannot resize image /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Ensure instance console log exists: /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:03 user nova-compute[74319]: INFO os_vif [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57')
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.compute.manager [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Took 13.59 seconds to build instance.
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.compute.manager [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Took 12.46 seconds to build instance.
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-36df83c8-4bbf-4a2c-9628-8bc58433508b tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.832s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name hda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No VIF found with MAC fa:16:3e:ea:e3:d4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Using config drive
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef3747b-8e44-4cb6-9c2f-10308d566a05 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.615s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.network.neutron [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updated VIF entry in instance network info cache for port 007cce73-5719-4d78-a8ee-eb979da7f5a6. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG nova.network.neutron [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7367a8b2-2e3e-4487-ac8b-df34b0a125ac req-0e0112fd-fdbc-4a20-9318-c7396d23e67c service nova] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Creating config drive at /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_agtfevm {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_agtfevm" returned: 0 in 0.078s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Successfully updated port: 4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquired lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-changed-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Refreshing instance network info cache due to event network-changed-4cac5ad3-229f-47ca-ae69-a46ca5e95daa. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] Acquiring lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating instance_info_cache with network_info: [{"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Releasing lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Instance network_info: |[{"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] Acquired lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Refreshing network info cache for port 4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Start _get_guest_xml network_info=[{"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:55:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-887241984',display_name='tempest-VolumesAssistedSnapshotsTest-server-887241984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-887241984',id=7,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILiUGhfUJA0L93RpUjBq8QOpqFpXuY0AHB0g/JPF3zhtJvmtE0XG3rTsOjpl3mJlbyeWqzEhzUQy9+7XXleLXpmU2FUdwDurU97FSu61SM/W6clmErpM6NFtBsHNlvNJA==',key_name='tempest-keypair-1259822635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57c8b19c853e4f7c9f004133687b7638',ramdisk_id='',reservation_id='r-hc59vf3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1722884665',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1722884665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17e2ebdb640849858c5d396beac1d882',uuid=7ab1d632-5872-4c23-ba05-7a53e2b2a10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converting VIF {"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.objects.instance [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:55:04 user nova-compute[74319]:   <uuid>7ab1d632-5872-4c23-ba05-7a53e2b2a10c</uuid>
Oct 30 13:55:04 user nova-compute[74319]:   <name>instance-00000007</name>
Oct 30 13:55:04 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:55:04 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:55:04 user nova-compute[74319]:   <metadata>
Oct 30 13:55:04 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:55:04 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-887241984</nova:name>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:55:04</nova:creationTime>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:55:04 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:55:04 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:owner>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:user uuid="17e2ebdb640849858c5d396beac1d882">tempest-VolumesAssistedSnapshotsTest-1722884665-project-member</nova:user>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:project uuid="57c8b19c853e4f7c9f004133687b7638">tempest-VolumesAssistedSnapshotsTest-1722884665</nova:project>
Oct 30 13:55:04 user nova-compute[74319]:       </nova:owner>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:55:04 user nova-compute[74319]:       <nova:ports>
Oct 30 13:55:04 user nova-compute[74319]:         <nova:port uuid="4cac5ad3-229f-47ca-ae69-a46ca5e95daa">
Oct 30 13:55:04 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 13:55:04 user nova-compute[74319]:         </nova:port>
Oct 30 13:55:04 user nova-compute[74319]:       </nova:ports>
Oct 30 13:55:04 user nova-compute[74319]:     </nova:instance>
Oct 30 13:55:04 user nova-compute[74319]:   </metadata>
Oct 30 13:55:04 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:55:04 user nova-compute[74319]:     <system>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="serial">7ab1d632-5872-4c23-ba05-7a53e2b2a10c</entry>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="uuid">7ab1d632-5872-4c23-ba05-7a53e2b2a10c</entry>
Oct 30 13:55:04 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:55:04 user nova-compute[74319]:     </system>
Oct 30 13:55:04 user nova-compute[74319]:   </sysinfo>
Oct 30 13:55:04 user nova-compute[74319]:   <os>
Oct 30 13:55:04 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:55:04 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:55:04 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:55:04 user nova-compute[74319]:   </os>
Oct 30 13:55:04 user nova-compute[74319]:   <features>
Oct 30 13:55:04 user nova-compute[74319]:     <acpi/>
Oct 30 13:55:04 user nova-compute[74319]:     <apic/>
Oct 30 13:55:04 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:55:04 user nova-compute[74319]:   </features>
Oct 30 13:55:04 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:55:04 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:55:04 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:55:04 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:55:04 user nova-compute[74319]:   </clock>
Oct 30 13:55:04 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:55:04 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:55:04 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:55:04 user nova-compute[74319]:   </cpu>
Oct 30 13:55:04 user nova-compute[74319]:   <devices>
Oct 30 13:55:04 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:55:04 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:55:04 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk"/>
Oct 30 13:55:04 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:55:04 user nova-compute[74319]:     </disk>
Oct 30 13:55:04 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:55:04 user nova-compute[74319]:       <mac address="fa:16:3e:0b:f0:6e"/>
Oct 30 13:55:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:04 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:55:04 user nova-compute[74319]:       <target dev="tap4cac5ad3-22"/>
Oct 30 13:55:04 user nova-compute[74319]:     </interface>
Oct 30 13:55:04 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:55:04 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/console.log" append="off"/>
Oct 30 13:55:04 user nova-compute[74319]:     </serial>
Oct 30 13:55:04 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:55:04 user nova-compute[74319]:     <video>
Oct 30 13:55:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:04 user nova-compute[74319]:     </video>
Oct 30 13:55:04 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:55:04 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:55:04 user nova-compute[74319]:     </rng>
Oct 30 13:55:04 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:55:04 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:55:04 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:55:04 user nova-compute[74319]:     </memballoon>
Oct 30 13:55:04 user nova-compute[74319]:   </devices>
Oct 30 13:55:04 user nova-compute[74319]: </domain>
Oct 30 13:55:04 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-887241984',display_name='tempest-VolumesAssistedSnapshotsTest-server-887241984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-887241984',id=7,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILiUGhfUJA0L93RpUjBq8QOpqFpXuY0AHB0g/JPF3zhtJvmtE0XG3rTsOjpl3mJlbyeWqzEhzUQy9+7XXleLXpmU2FUdwDurU97FSu61SM/W6clmErpM6NFtBsHNlvNJA==',key_name='tempest-keypair-1259822635',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57c8b19c853e4f7c9f004133687b7638',ramdisk_id='',reservation_id='r-hc59vf3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1722884665',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1722884665-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17e2ebdb640849858c5d396beac1d882',uuid=7ab1d632-5872-4c23-ba05-7a53e2b2a10c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converting VIF {"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG os_vif [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '169e33a1-9b03-501d-87fa-eb031e960113', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cac5ad3-22, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cac5ad3-22, col_values=(('qos', UUID('f493979e-1cb2-4a94-aaf4-5c7b82b878bb')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cac5ad3-22, col_values=(('external_ids', {'iface-id': '4cac5ad3-229f-47ca-ae69-a46ca5e95daa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:f0:6e', 'vm-uuid': '7ab1d632-5872-4c23-ba05-7a53e2b2a10c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:04 user nova-compute[74319]: INFO os_vif [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22')
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:55:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] No VIF found with MAC fa:16:3e:0b:f0:6e, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG nova.network.neutron [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updated VIF entry in instance network info cache for port 4cac5ad3-229f-47ca-ae69-a46ca5e95daa. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG nova.network.neutron [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating instance_info_cache with network_info: [{"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46af4cee-5e06-4aa9-bbd4-13794bcecf4a req-fd2ac6f0-2b0c-4403-abc0-5da145507df9 service nova] Releasing lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] No waiting events found dispatching network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:06 user nova-compute[74319]: WARNING nova.compute.manager [req-a19c8050-8054-45ab-9771-137f0e91aa4f req-4abf2e25-9b38-4725-a95b-3455974d2067 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received unexpected event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c for instance with vm_state active and task_state None.
Oct 30 13:55:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG nova.compute.manager [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG nova.compute.manager [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] No waiting events found dispatching network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:09 user nova-compute[74319]: WARNING nova.compute.manager [req-cbc92030-313f-4533-971a-9f600e045fe3 req-4c843a2a-36fd-4a0d-98ac-874e934e7994 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received unexpected event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c for instance with vm_state active and task_state None.
Oct 30 13:55:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Instance spawned successfully.
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Instance spawned successfully.
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:11 user nova-compute[74319]: INFO nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Took 11.77 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:11 user nova-compute[74319]: INFO nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Took 9.13 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:11 user nova-compute[74319]: INFO nova.compute.manager [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Took 12.66 seconds to build instance.
Oct 30 13:55:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cab0dc68-c75b-4ab6-9e20-e3ec1e4829f1 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.790s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:11 user nova-compute[74319]: INFO nova.compute.manager [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Took 10.28 seconds to build instance.
Oct 30 13:55:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-777c3b5b-fada-4040-b954-4280ff70d62c tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.407s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] No waiting events found dispatching network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:19 user nova-compute[74319]: WARNING nova.compute.manager [req-9ebb6d16-1561-4811-97ed-ae35c56c417b req-0848f51a-b66f-4dfe-b83b-2aac8dd67baa service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received unexpected event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 for instance with vm_state active and task_state None.
Oct 30 13:55:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7951MB free_disk=25.777626037597656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4a623a60-8c92-4860-92a0-57b606be809a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.570s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] No waiting events found dispatching network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received unexpected event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] No waiting events found dispatching network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received unexpected event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] No waiting events found dispatching network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received unexpected event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] No waiting events found dispatching network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received unexpected event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa for instance with vm_state active and task_state None.
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] No waiting events found dispatching network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:21 user nova-compute[74319]: WARNING nova.compute.manager [req-9c101a5d-a61e-4ebc-894e-041fe23508cb req-9f61042a-f558-4ff5-b024-16511fb9c9e4 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received unexpected event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa for instance with vm_state active and task_state None.
Oct 30 13:55:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:22 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:55:22 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating instance_info_cache with network_info: [{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:55:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:55:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:55:31 user nova-compute[74319]: INFO nova.compute.claims [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Claim successful on node user
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 13:55:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:55:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:55:32 user nova-compute[74319]: DEBUG nova.policy [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2eed42254fc948d7a606fe240672ec01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a57ddfde4dc84a5ba386188705391e4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:55:32 user nova-compute[74319]: INFO nova.virt.block_device [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Booting with volume 05e121ec-970e-4e6a-8701-36f0febdac05 at /dev/vda
Oct 30 13:55:32 user nova-compute[74319]: DEBUG os_brick.utils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:55:32 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmptxa8x3s2/privsep.sock']
Oct 30 13:55:32 user sudo[85346]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmptxa8x3s2/privsep.sock
Oct 30 13:55:32 user sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Successfully created port: 24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Successfully updated port: 24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquired lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-changed-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Refreshing instance network info cache due to event network-changed-24cf35b1-7eee-4873-b57a-8a04d0f7377e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] Acquiring lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:55:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Releasing lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance network_info: |[{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] Acquired lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Refreshing network info cache for port 24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:55:34 user sudo[85346]: pam_unix(sudo:session): session closed for user root
Oct 30 13:55:34 user nova-compute[74319]: INFO oslo.privsep.daemon [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Spawned new privsep daemon via rootwrap
Oct 30 13:55:34 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 30 13:55:34 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 30 13:55:34 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 30 13:55:34 user nova-compute[74319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85349
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eaf54d-5457-4bc3-8a67-58e505232e84]: (2,) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0dfd9b-0534-4c11-93c4-959ca69779d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: WARNING os_brick.initiator.connectors.nvmeof [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[096b2e39-3988-4f1b-9474-1d10e7abfe26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f944d905-8a6b-4496-8b80-e145a8511864]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f8000b-3c1c-4729-aa71-4615cf23dc76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:55:34 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4127bb6-1d15-4044-8ac6-23d74c0a0d2f]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG os_brick.utils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] <== get_connector_properties: return (2100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating existing volume attachment record: b8a39dd5-f136-48eb-8d85-a974bcb507bf {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updated VIF entry in instance network info cache for port 24cf35b1-7eee-4873-b57a-8a04d0f7377e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f66d6dc-7731-4601-a1ef-ce9d19c54774 req-fa0fbaec-0b76-474e-aae6-81641aecf843 service nova] Releasing lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:55:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:55:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Creating image(s)
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Ensure instance console log exists: /opt/stack/data/nova/instances/67280b94-8d8c-47ce-800d-a88d7de8e3d3/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Start _get_guest_xml network_info=[{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'b8a39dd5-f136-48eb-8d85-a974bcb507bf', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '67280b94-8d8c-47ce-800d-a88d7de8e3d3', 'attached_at': '', 'detached_at': '', 'volume_id': '05e121ec-970e-4e6a-8701-36f0febdac05', 'serial': '05e121ec-970e-4e6a-8701-36f0febdac05'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:55:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connector [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Factory for ISCSI on None {{(pid=74319) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:55:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:55:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:55:54 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[76140ee8-7889-4775-ae10-dc6e18fc49da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:55:54 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89d66b8-055d-4d24-b301-d6235cdaf930]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05] added
Oct 30 13:55:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d52eade-d655-4ad9-bbda-666fc3625c9a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2577757f-df9e-4292-aa79-430cded0b9bc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v STzpahxi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v STzpahxi" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9ec35f-e4cc-4501-b561-8d26f7ebf7ea]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'STzpahxi'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124d540-ed2a-4428-9a6d-27db59ec31b2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b62dec1-a238-42cb-8e12-c914988eb9a4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 13:55:54 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 13:55:54 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:55:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 13:55:54 user nova-compute[74319]: 
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[db91492a-b6c3-44ad-a114-61f7f4fe059d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260]
Oct 30 13:55:54 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260] successful.
Oct 30 13:55:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cadffa4-23cd-4055-a3e7-ad8d0a82aaa1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3326a811-1b72-4899-817b-9b1b75d3b58a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:55:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:55:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b71334-bf94-46ad-ad36-aebfc734eead]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:55:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23736633265663938', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736633265663938', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1904580473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904580473',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZamBmUkUghkSL/oO2f7Dmvtu1DvtJs7O6EIiD+2htZ6cPI2j/H+wmBiWZod4ZFO/LHmgTlAL0JbCLWEshjXSJ4gRIVx4HKrU3cNmOkCr+z/W8UAkgM6yxYqbgXZNSCgw==',key_name='tempest-keypair-1468331112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a57ddfde4dc84a5ba386188705391e4d',ramdisk_id='',reservation_id='r-5sca1jmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1977745252',owner_user_name='tempest-ServerActionsV293TestJSON-1977745252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2eed42254fc948d7a606fe240672ec01',uuid=67280b94-8d8c-47ce-800d-a88d7de8e3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converting VIF {"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lazy-loading 'pci_devices' on Instance uuid 67280b94-8d8c-47ce-800d-a88d7de8e3d3 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:55:55 user nova-compute[74319]:   <uuid>67280b94-8d8c-47ce-800d-a88d7de8e3d3</uuid>
Oct 30 13:55:55 user nova-compute[74319]:   <name>instance-00000008</name>
Oct 30 13:55:55 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:55:55 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:55:55 user nova-compute[74319]:   <metadata>
Oct 30 13:55:55 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:55:55 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:55:55 user nova-compute[74319]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1904580473</nova:name>
Oct 30 13:55:55 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:55:54</nova:creationTime>
Oct 30 13:55:55 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:55:55 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:55:55 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:55:55 user nova-compute[74319]:       <nova:owner>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:user uuid="2eed42254fc948d7a606fe240672ec01">tempest-ServerActionsV293TestJSON-1977745252-project-member</nova:user>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:project uuid="a57ddfde4dc84a5ba386188705391e4d">tempest-ServerActionsV293TestJSON-1977745252</nova:project>
Oct 30 13:55:55 user nova-compute[74319]:       </nova:owner>
Oct 30 13:55:55 user nova-compute[74319]:       <nova:ports>
Oct 30 13:55:55 user nova-compute[74319]:         <nova:port uuid="24cf35b1-7eee-4873-b57a-8a04d0f7377e">
Oct 30 13:55:55 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 13:55:55 user nova-compute[74319]:         </nova:port>
Oct 30 13:55:55 user nova-compute[74319]:       </nova:ports>
Oct 30 13:55:55 user nova-compute[74319]:     </nova:instance>
Oct 30 13:55:55 user nova-compute[74319]:   </metadata>
Oct 30 13:55:55 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:55:55 user nova-compute[74319]:     <system>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="serial">67280b94-8d8c-47ce-800d-a88d7de8e3d3</entry>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="uuid">67280b94-8d8c-47ce-800d-a88d7de8e3d3</entry>
Oct 30 13:55:55 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:55:55 user nova-compute[74319]:     </system>
Oct 30 13:55:55 user nova-compute[74319]:   </sysinfo>
Oct 30 13:55:55 user nova-compute[74319]:   <os>
Oct 30 13:55:55 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:55:55 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:55:55 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:55:55 user nova-compute[74319]:   </os>
Oct 30 13:55:55 user nova-compute[74319]:   <features>
Oct 30 13:55:55 user nova-compute[74319]:     <acpi/>
Oct 30 13:55:55 user nova-compute[74319]:     <apic/>
Oct 30 13:55:55 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:55:55 user nova-compute[74319]:   </features>
Oct 30 13:55:55 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:55:55 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:55:55 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:55:55 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:55:55 user nova-compute[74319]:   </clock>
Oct 30 13:55:55 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:55:55 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:55:55 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:55:55 user nova-compute[74319]:   </cpu>
Oct 30 13:55:55 user nova-compute[74319]:   <devices>
Oct 30 13:55:55 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:55:55 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:55:55 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 13:55:55 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:55:55 user nova-compute[74319]:       <serial>05e121ec-970e-4e6a-8701-36f0febdac05</serial>
Oct 30 13:55:55 user nova-compute[74319]:     </disk>
Oct 30 13:55:55 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:55:55 user nova-compute[74319]:       <mac address="fa:16:3e:66:da:a1"/>
Oct 30 13:55:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:55 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:55:55 user nova-compute[74319]:       <target dev="tap24cf35b1-7e"/>
Oct 30 13:55:55 user nova-compute[74319]:     </interface>
Oct 30 13:55:55 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:55:55 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/67280b94-8d8c-47ce-800d-a88d7de8e3d3/console.log" append="off"/>
Oct 30 13:55:55 user nova-compute[74319]:     </serial>
Oct 30 13:55:55 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:55:55 user nova-compute[74319]:     <video>
Oct 30 13:55:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:55:55 user nova-compute[74319]:     </video>
Oct 30 13:55:55 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:55:55 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:55:55 user nova-compute[74319]:     </rng>
Oct 30 13:55:55 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:55:55 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:55:55 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:55:55 user nova-compute[74319]:     </memballoon>
Oct 30 13:55:55 user nova-compute[74319]:   </devices>
Oct 30 13:55:55 user nova-compute[74319]: </domain>
Oct 30 13:55:55 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1904580473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904580473',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZamBmUkUghkSL/oO2f7Dmvtu1DvtJs7O6EIiD+2htZ6cPI2j/H+wmBiWZod4ZFO/LHmgTlAL0JbCLWEshjXSJ4gRIVx4HKrU3cNmOkCr+z/W8UAkgM6yxYqbgXZNSCgw==',key_name='tempest-keypair-1468331112',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a57ddfde4dc84a5ba386188705391e4d',ramdisk_id='',reservation_id='r-5sca1jmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1977745252',owner_user_name='tempest-ServerActionsV293TestJSON-1977745252-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2eed42254fc948d7a606fe240672ec01',uuid=67280b94-8d8c-47ce-800d-a88d7de8e3d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converting VIF {"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG os_vif [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5dc8e43b-c06e-50e5-a6de-8a8b1d991297', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24cf35b1-7e, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24cf35b1-7e, col_values=(('qos', UUID('873c210c-aac0-4682-9162-4d4f42df7e7f')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24cf35b1-7e, col_values=(('external_ids', {'iface-id': '24cf35b1-7eee-4873-b57a-8a04d0f7377e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:da:a1', 'vm-uuid': '67280b94-8d8c-47ce-800d-a88d7de8e3d3'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:55 user nova-compute[74319]: INFO os_vif [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e')
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:55:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] No VIF found with MAC fa:16:3e:66:da:a1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] No waiting events found dispatching network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:57 user nova-compute[74319]: WARNING nova.compute.manager [req-79f62c3a-212c-4ca8-a781-63bfa41300a4 req-270da990-ee7a-4ced-a422-a49abf55fe95 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received unexpected event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e for instance with vm_state building and task_state spawning.
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:55:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance spawned successfully.
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] No waiting events found dispatching network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:55:59 user nova-compute[74319]: WARNING nova.compute.manager [req-f2b9f808-c074-4c37-8832-5b01e0f884b0 req-e31cf02a-35d0-46c0-99d7-6657ee8b02a7 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received unexpected event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e for instance with vm_state building and task_state spawning.
Oct 30 13:55:59 user nova-compute[74319]: INFO nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 30 13:55:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:55:59 user nova-compute[74319]: INFO nova.compute.manager [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Took 28.74 seconds to build instance.
Oct 30 13:55:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0cc2809a-b672-45d9-9eec-792cb2d9eb00 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.879s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:56:08 user nova-compute[74319]: INFO nova.compute.claims [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Claim successful on node user
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.333s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:56:08 user nova-compute[74319]: INFO nova.compute.claims [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Claim successful on node user
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:56:08 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:56:08 user nova-compute[74319]: INFO nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Booting with volume d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b at /dev/vda
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.policy [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad3a7be151634bfd9316ddb7cc8fb716', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f4d7b5d57b48bb99b757884cfb1e74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71687ea-cebb-4862-8518-2eda190d965e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0647e-c8a8-482c-9b0b-ba70ed572634]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce13f411-6743-4bf0-b229-4f95c1ca7f97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d61cf3-d0e8-4a7a-8d64-866968c63994]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:08 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[22999584-dfbd-47ac-a5b0-4b14db37a532]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating existing volume attachment record: 968d3c51-0e93-4743-8135-0fca93666e5d {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:56:08 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:56:09 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:56:09 user nova-compute[74319]: INFO nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Booting with volume 6abbac29-245b-41c6-a8ae-c612a411e37a at /dev/vda
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dac77f2-2861-4375-81b9-c53eee850c2e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ff79a-148f-4126-ba99-aea64f83455c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully created port: 993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.policy [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0383d20b22434a7fb704e65226cf66ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b92b41eede4ba1873ca7c4574d31e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b881272e-009a-4139-8003-32071dd67aa1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80c9898-575e-44eb-94d7-1d0b131135fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:09 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c819a61-a9a2-4d33-ac45-b0b528befd5b]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating existing volume attachment record: 911172a1-bb3d-4a8d-9deb-5ab8b4a72063 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:09 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully created port: 78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully created port: f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully created port: 738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully created port: 5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully created port: bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully created port: 4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully created port: 56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully created port: 8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: 993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-993d868c-2638-4168-9bcb-6aa370bb9258. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:12 user nova-compute[74319]: DEBUG nova.network.neutron [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port 993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully created port: f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:13 user nova-compute[74319]: DEBUG nova.network.neutron [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:13 user nova-compute[74319]: DEBUG nova.network.neutron [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-456814bc-ab45-4926-a33c-2faaa733896e req-d1522783-fa57-48ae-b903-e160009f9f87 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-f2757f95-16d0-4e3b-9696-adb3c8920856. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-788f9187-2409-4b33-8de8-dca15863cffb req-ffab39d5-91c1-4e4b-bc25-b7d46fa22cf3 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-da0ac42f-e842-4c4b-a7c8-690bd3679fab. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:14 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: 78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: 1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9efba4e-221d-4a7b-876f-8bc1e5f27630 req-e46f7c47-51e7-44e2-ba7b-ad927e308566 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:56:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: 738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port 1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e990dcbc-2b27-4246-b7f2-26c17ac33520 req-996762c0-c8ca-47a4-98f1-6694ec058cef service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: 2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-78d89f62-5c8d-4037-8cc5-75197a31f61e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port 78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: 5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-738547bc-e918-4ad8-9dd2-f200dee5daeb. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port 738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Successfully updated port: 56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-bc01d474-0eab-48f5-841c-8fce27706c20. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6c85ad0a-a0f1-44b0-ba38-4909e06dd1dc req-69f926ff-9fd9-467b-92ba-6e15a6154210 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-2eab49af-373e-46f0-91d9-d842b75b8d3f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port 2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: 4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-5fe430f4-ccb6-40c5-b161-b05ef94daeb4. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port 5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53ac915b-dbf2-4f2f-b075-0026e77fcf69 req-ea66fdd6-abc3-4034-b8b3-a44f8c9c54a5 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:18 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-56c44b1b-00c2-47ce-b2a5-3a01ff177c59. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: 8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:56:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port 4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port 8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Successfully updated port: f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4069aaa4-3365-403c-b58f-f0d423b53f1a req-943bb28b-da22-4bae-803b-fb99869af087 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:20 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:21 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance network_info: |[{"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port 56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:56:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7467MB free_disk=25.630809783935547GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-f75f6f1a-cf5c-4f98-8391-a0f12a825252. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4a623a60-8c92-4860-92a0-57b606be809a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:56:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:23 user nova-compute[74319]: DEBUG nova.network.neutron [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updated VIF entry in instance network info cache for port 56c44b1b-00c2-47ce-b2a5-3a01ff177c59. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:23 user nova-compute[74319]: DEBUG nova.network.neutron [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-34067ed2-acce-4e1c-be39-a7bf4e1284ec req-91361c1f-a531-4244-8a35-99a8c4fc6158 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-changed-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Refreshing instance network info cache due to event network-changed-21dcf81b-73bc-43c1-a5b4-e93c62d76925. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] Acquiring lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] Acquired lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Refreshing network info cache for port 21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updated VIF entry in instance network info cache for port 21dcf81b-73bc-43c1-a5b4-e93c62d76925. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating instance_info_cache with network_info: [{"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e73c9ea-ca7f-4319-b292-c826830aaae9 req-01e5baae-f7b4-4556-97d9-56201e2c65cd service nova] Releasing lock "refresh_cache-4b25c9fe-a007-432e-b3a0-9b0df509b33b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance network_info: |[{"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.network.neutron [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 13:56:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:56:25 user nova-compute[74319]: DEBUG nova.network.neutron [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updated VIF entry in instance network info cache for port f75f6f1a-cf5c-4f98-8391-a0f12a825252. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:25 user nova-compute[74319]: DEBUG nova.network.neutron [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aea39f5e-ed2a-46df-9964-aa707f69241c req-768cb365-9062-4289-b71b-6d451039aa91 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-changed-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Refreshing instance network info cache due to event network-changed-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] Acquiring lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] Acquired lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Refreshing network info cache for port e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updated VIF entry in instance network info cache for port e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-04a027b8-1fc4-4dd4-b990-f65641e3cc3b req-4bb65bf8-4f0e-4960-975e-c78a3ea5d24d service nova] Releasing lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:30 user nova-compute[74319]: INFO nova.compute.manager [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Attaching volume 9f3043bf-dcde-462a-b1b2-d07fdad582e6 to /dev/vdb
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.utils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe29f1a-bde2-4459-bf1e-1571572eb876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6202ff4-49be-405f-b046-8ac08a3a7d26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f806bbf6-0efb-4b98-a1bb-cff27cf7781f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9309c9-fcd1-48ec-aaef-76aef9f63ad4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:30 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b839245e-a381-4ea7-bb4a-201f6a76feb2]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG os_brick.utils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:30 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating existing volume attachment record: 3955d30c-b2e7-4795-acb5-93db5792fae0 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:32 user nova-compute[74319]: INFO nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Booting with volume f61580e2-fad5-45ba-af71-d69ab8f62c5e at /dev/vdb
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc1bb1d-0e55-4f25-bd31-b3b6a601d82e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6542b0-d958-4ff3-9642-df3cc2a5dd20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[116109f6-4e13-4b83-9ffa-71e9c84663da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a74b50-39b0-47b2-9daa-06f088c03d13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:33 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd201d-73e9-4ca3-9d60-bac210ac0036]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:33 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating existing volume attachment record: 1848139a-8d70-4f9d-bbe9-b875a98bc190 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-changed-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Refreshing instance network info cache due to event network-changed-39585cd9-befe-421d-a47c-67a5f53e096c. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] Acquiring lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] Acquired lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.network.neutron [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Refreshing network info cache for port 39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-changed-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Refreshing instance network info cache due to event network-changed-90db37ff-95ac-4232-9116-f20a7ab74a27. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] Acquiring lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] Acquired lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG nova.network.neutron [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Refreshing network info cache for port 90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updated VIF entry in instance network info cache for port 39585cd9-befe-421d-a47c-67a5f53e096c. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating instance_info_cache with network_info: [{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6e7e7f3b-95c8-4cc7-9282-7845794ac8b8 req-621b0ce6-79a3-4321-8928-61b95e4079f4 service nova] Releasing lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updated VIF entry in instance network info cache for port 90db37ff-95ac-4232-9116-f20a7ab74a27. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating instance_info_cache with network_info: [{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-21a44f2f-168e-433c-b18c-23f9ddbd2ff1 req-3e48589e-cbda-4b09-8450-1184ff0f7bfd service nova] Releasing lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-changed-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Refreshing instance network info cache due to event network-changed-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] Acquiring lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] Acquired lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Refreshing network info cache for port 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updated VIF entry in instance network info cache for port 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7436fd2-5ba5-4dab-a6d8-20847c9004de req-71e843c7-9610-4c4a-b603-36048cd88f2b service nova] Releasing lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lazy-loading 'flavor' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:48 user nova-compute[74319]: INFO nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Booting with volume 7ef92531-9ece-46b1-a8dd-64a5e12f7e29 at /dev/vdb
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:48 user nova-compute[74319]: INFO nova.compute.manager [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attaching volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159 to /dev/vdb
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d855c26-929c-4689-920e-baa687057ce4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a303f-6905-4a53-8f7f-4d86a361ff70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71e7745-fd36-4c8a-a460-160fc20719bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e83db5-7a1b-4f68-a393-29c3eef95133]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:48 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[55e38661-7fd3-4ddd-b2a3-4eb34485cc47]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:48 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating existing volume attachment record: aed0341d-5b42-4dd7-96e6-1b9b92f9c814 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-changed-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing instance network info cache due to event network-changed-007cce73-5719-4d78-a8ee-eb979da7f5a6. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:49 user nova-compute[74319]: DEBUG nova.network.neutron [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing network info cache for port 007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updated VIF entry in instance network info cache for port 007cce73-5719-4d78-a8ee-eb979da7f5a6. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-390698e8-be72-415e-9c9b-036377d19868 req-0618859d-6eae-4615-bd0a-c3e326521762 service nova] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'pci_requests' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Object Instance<279dca02-f5a2-44cb-9c37-3802a64e7901> lazy-loaded attributes: flavor,pci_requests {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG nova.policy [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be414360ec564f668e2b0704981a231c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e9adc75880c451b9ec528bcb47ca8dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:56:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG nova.network.neutron [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Successfully created port: 8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG nova.compute.manager [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-changed-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG nova.compute.manager [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Refreshing instance network info cache due to event network-changed-4cac5ad3-229f-47ca-ae69-a46ca5e95daa. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] Acquiring lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] Acquired lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:51 user nova-compute[74319]: DEBUG nova.network.neutron [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Refreshing network info cache for port 4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOAUpsji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:52 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:56:52 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:56:52 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ffef3-f67d-41c2-9421-85f3e3db7583]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:56:52 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.utils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab516dec-abf1-43ab-be15-5461ffd0ac52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6] added
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f0d74b-1ee9-4482-9f71-4165e62bb261]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[19566bb5-6a3f-434f-bd56-7785e35b0ca7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cca7a2-be8c-40bb-9699-8ae16cd8fa1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec69e6e-4572-41d2-8f17-6111dcc84ebf]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOAUpsji {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97c33be-7c33-42fc-b600-916190a4574f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c712486-f11f-4dea-b8af-88a8f6cfd984]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tOAUpsji" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e5a16-6523-4fa6-b706-04023aab09d9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tOAUpsji'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:52 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0213733-a733-4407-911a-6b4aeeb06cc8]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.utils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating existing volume attachment record: 1ee8ab69-3f81-4f72-8dd7-a1bbb5acf3a8 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4c51a-bce3-4bb3-8399-a5628be479fe]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4976083d-f0b5-42e5-a58a-85a4a1cee2f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[056f08a7-99ea-49e2-9c22-1423896d8ad0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260]
Oct 30 13:56:52 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260] successful.
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4690f355-955a-4eff-ae1f-b9f40f1861e3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab284d7-adf6-4215-b4ec-0bc97bf14ee2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:56:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6cc02f-0fa0-4b32-9372-008757522f20]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG nova.objects.instance [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lazy-loading 'flavor' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.126s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updated VIF entry in instance network info cache for port 4cac5ad3-229f-47ca-ae69-a46ca5e95daa. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating instance_info_cache with network_info: [{"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-db47f44b-ed82-4752-90e3-b7d67d4fb524 req-8e2da341-c7c4-4934-aadc-4b0c203d3215 service nova] Releasing lock "refresh_cache-7ab1d632-5872-4c23-ba05-7a53e2b2a10c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Successfully updated port: 8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-changed-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing instance network info cache due to event network-changed-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOAUpsji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23934336462393437', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934336462393437', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 13:56:53 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:56:53 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 13:56:53 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:56:53 user nova-compute[74319]:   <serial>9f3043bf-dcde-462a-b1b2-d07fdad582e6</serial>
Oct 30 13:56:53 user nova-compute[74319]: </disk>
Oct 30 13:56:53 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Refreshing network info cache for port 8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG os_vif [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b4b14df-da14-58e5-a159-7d3d898a9dcc', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cb91cb3-34, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cb91cb3-34, col_values=(('qos', UUID('354e24c7-6b02-4e20-895f-74de731fe372')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cb91cb3-34, col_values=(('external_ids', {'iface-id': '8cb91cb3-34de-48cd-bd26-8c3ce1a840f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:45:9a', 'vm-uuid': '279dca02-f5a2-44cb-9c37-3802a64e7901'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:df:ad:0d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:56:54 user nova-compute[74319]: INFO os_vif [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34')
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] attach device xml: <interface type="ethernet">
Oct 30 13:56:54 user nova-compute[74319]:   <mac address="fa:16:3e:75:45:9a"/>
Oct 30 13:56:54 user nova-compute[74319]:   <model type="virtio"/>
Oct 30 13:56:54 user nova-compute[74319]:   <mtu size="1442"/>
Oct 30 13:56:54 user nova-compute[74319]:   <target dev="tap8cb91cb3-34"/>
Oct 30 13:56:54 user nova-compute[74319]: </interface>
Oct 30 13:56:54 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:56:54 user nova-compute[74319]: WARNING nova.compute.manager [req-328923ef-ae0f-4794-8b41-a4d44858da55 req-c1dfb24c-4fb6-4211-b5d8-5046fd54b56a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 for instance with vm_state active and task_state None.
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name hda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No VIF found with MAC fa:16:3e:ea:e3:d4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:56:54 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:56:54</nova:creationTime>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:56:54 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:56:54 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:owner>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:56:54 user nova-compute[74319]:   </nova:owner>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:56:54 user nova-compute[74319]:   <nova:ports>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:56:54 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:56:54 user nova-compute[74319]:     </nova:port>
Oct 30 13:56:54 user nova-compute[74319]:     <nova:port uuid="8cb91cb3-34de-48cd-bd26-8c3ce1a840f1">
Oct 30 13:56:54 user nova-compute[74319]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Oct 30 13:56:54 user nova-compute[74319]:     </nova:port>
Oct 30 13:56:54 user nova-compute[74319]:   </nova:ports>
Oct 30 13:56:54 user nova-compute[74319]: </nova:instance>
Oct 30 13:56:54 user nova-compute[74319]:  {{(pid=74319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07f99106-4485-46a6-b053-d14260113dfa tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.183s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updated VIF entry in instance network info cache for port 8cb91cb3-34de-48cd-bd26-8c3ce1a840f1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:56:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:56:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f73495f-df0f-47e0-b51e-062bbb8e4f68 req-9060f960-f0b9-4e05-8619-2559c3e6a5d2 service nova] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0927be57-d0f9-47f2-a08b-61d0ee03d0c4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.503s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: INFO nova.compute.manager [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Attaching volume a8452969-d0a2-4506-a2d9-8b1a71afc389 to /dev/vdb
Oct 30 13:56:56 user nova-compute[74319]: INFO nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Booting with volume 8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 at /dev/vdc
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'flavor' on Instance uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:56:56 user nova-compute[74319]: WARNING nova.compute.manager [req-d3783c29-d376-4fd8-abbc-ef2d3724d29d req-50d66652-6be8-4beb-a841-13abbe872a4b service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 for instance with vm_state active and task_state None.
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: INFO nova.compute.manager [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Attaching volume fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 to /dev/vdb
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.utils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a901c67d-73be-4acf-8802-c5847b1356ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4790c3-98b1-40f7-82c7-3625fbefdac2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5fd17c-3662-4509-956b-ac93a045e73a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced10955-6133-4d45-8fb1-151c404240a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[15561229-7f46-41bd-8691-d8c0891296c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:56 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35af3de-bd35-4340-b09b-a0e3d7544aba]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.utils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating existing volume attachment record: e6150484-c15a-4004-8658-afc787798573 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[027427b6-77d3-4faf-84d6-61eda38ac500]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71465cd3-2ab5-4306-aa09-291885d9b013]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[17be492e-b510-4006-8f84-815c2b952bdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:56 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1155e0fb-25e5-44fa-bc60-89c8b002b595]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.utils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating existing volume attachment record: 2118db7a-93e2-42ff-9a95-a4a29ffd54d2 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:56:56 user nova-compute[74319]: INFO nova.compute.manager [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Attaching volume 9ad4abce-a5b6-4de9-b6e3-849dc81c8171 to /dev/vdb
Oct 30 13:56:56 user nova-compute[74319]: DEBUG os_brick.utils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb07c6e-549d-4976-8633-dad00e814130]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[741a1b45-6c7a-42b1-9f7d-1b0f74b4ae95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8c23b1-4f11-4c15-a925-9a4d3247928c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[43031870-378b-4231-985b-e20068a33291]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:56:57 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:56:57 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfa1de6-ebf8-4501-baef-83cd668c0be6]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG os_brick.utils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:56:57 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating existing volume attachment record: 6e6e6d20-1635-4e50-9f99-95edfee871dc {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:56:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:56:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:14 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:14 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:14 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81f25f0-eab3-45d7-8ae6-e0e9c511fc76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:14 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[693554f7-07a3-49b9-9009-d3fbc4c9c273]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159] added
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9414c686-8f9a-4d30-8df1-a513513b7828]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[10aee3bb-c676-4601-bbe0-275e02a22441]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxCNpYmg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxCNpYmg" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ce513-e73c-4189-8ddf-bba7d8bf9508]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxCNpYmg'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5adc6bf-82fe-480c-88d1-9c2ae6460a4f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec39e9b5-5094-4402-a12c-04cb32264383]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed899f-7e63-4d4a-bccf-9adaf389711b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]
Oct 30 13:57:14 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f66f5b-0168-4409-a62b-41f66be0b0b5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f66806-774c-4dc1-8a4c-65a92bbdbb87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a4f75c-015c-4d46-afd2-289d1f44297a]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26266613734666134', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266613734666134', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:15 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lazy-loading 'flavor' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 13:57:15 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:15 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 13:57:15 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:57:15 user nova-compute[74319]:   <serial>7f39bac7-e22f-44f7-9b2e-f9740d4d8159</serial>
Oct 30 13:57:15 user nova-compute[74319]: </disk>
Oct 30 13:57:15 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:57:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] No VIF found with MAC fa:16:3e:4a:db:68, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpRQCZqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:18 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:18 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:18 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30435f11-2627-4085-b2cc-4026d2202f07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:18 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed063d9-b7b0-49ff-a4ee-dbb067ea4636]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389] added
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc4cb7c-38a0-434c-af06-2da82a72857b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975bfc1-430e-43c8-b254-2c2f8d6a9f89]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpRQCZqi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VpRQCZqi" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bede4f9-96e0-4eae-b7f0-75f193293904]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VpRQCZqi'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[436b5cec-edb2-42d9-b3de-91138cc0b654]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[75469cc0-b089-4f90-955d-abafff93f845]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[89affb4e-e368-4424-9661-7ccf932d108f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260]
Oct 30 13:57:18 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf28f8-ea73-42eb-b807-aea09578f0b5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[83355edc-0bbf-4da3-9aff-7eb7b9f8e3cf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2b0f8f-6f09-4bc4-a089-e1a53c82641e]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpRQCZqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:18 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23137666464393230', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23137666464393230', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG nova.objects.instance [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lazy-loading 'flavor' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] attach device xml: <disk type="block" device="disk">
Oct 30 13:57:19 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:19 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 13:57:19 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:57:19 user nova-compute[74319]:   <serial>a8452969-d0a2-4506-a2d9-8b1a71afc389</serial>
Oct 30 13:57:19 user nova-compute[74319]: </disk>
Oct 30 13:57:19 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:57:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] No VIF found with MAC fa:16:3e:0b:f0:6e, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-changed-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Refreshing instance network info cache due to event network-changed-24cf35b1-7eee-4873-b57a-8a04d0f7377e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] Acquiring lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] Acquired lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Refreshing network info cache for port 24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:57:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7765MB free_disk=25.619525909423828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4a623a60-8c92-4860-92a0-57b606be809a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updated VIF entry in instance network info cache for port 24cf35b1-7eee-4873-b57a-8a04d0f7377e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2beede94-f711-424d-bc60-98d6658d442c req-038ca015-d9ea-44a6-9c78-a74ee48a8e75 service nova] Releasing lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:57:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:57:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating instance_info_cache with network_info: [{"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 13:57:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG nova.objects.instance [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lazy-loading 'flavor' on Instance uuid 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c0ec9a9b-0beb-4de4-b1d2-e83e8722dcd1 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.355s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.utils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42db336-ee57-48eb-9fb8-49e076a50155]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9b9c2e-35c8-4cba-972e-579c18e229bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[58480d83-fa09-465b-85bf-60296be9eafb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd209a-60e8-433f-872e-508068ec6e01]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:25 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36499a-badd-40bc-b824-9a1cc40480da]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG os_brick.utils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating existing volume attachment record: 3967200c-360e-4efe-a99e-fb52358fbf46 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:57:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-09362415-3829-4d5f-bfbd-926d94a7534b tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.882s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:25 user nova-compute[74319]: INFO nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Booting with volume 6dd7e3a6-c5b7-423e-a409-af6153226c08 at /dev/vdc
Oct 30 13:57:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:57:28 user nova-compute[74319]: INFO nova.compute.claims [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Claim successful on node user
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:57:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.policy [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f860f101c5034c638821e668d33eeeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6fce9483d048b580da3d18df44316d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:57:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Creating image(s)
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Successfully created port: d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Cannot resize image /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Ensure instance console log exists: /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Successfully updated port: d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquired lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-changed-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Refreshing instance network info cache due to event network-changed-d249fb65-92e3-468f-a94f-8a97f66d95c1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] Acquiring lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:57:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updating instance_info_cache with network_info: [{"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Releasing lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Instance network_info: |[{"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] Acquired lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Refreshing network info cache for port d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Start _get_guest_xml network_info=[{"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:57:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548470189',display_name='tempest-AttachVolumeNegativeTest-server-1548470189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548470189',id=11,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKZXvpqeVJ2cQHBORJmeu5dRHswoGJaHzxRZu3PiViY5yYJnBja5K9fT3zZh9f/pczAT6w35cLvvVGd+eY2hW8Js7G6goqExMRorPboyM/tKvmuVXaJ9wQdCfQfxBgOPA==',key_name='tempest-keypair-1014163901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40pt251u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=cf3fa11e-80b3-431c-945a-0ab17f07c5b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'pci_devices' on Instance uuid cf3fa11e-80b3-431c-945a-0ab17f07c5b3 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:57:30 user nova-compute[74319]:   <uuid>cf3fa11e-80b3-431c-945a-0ab17f07c5b3</uuid>
Oct 30 13:57:30 user nova-compute[74319]:   <name>instance-0000000b</name>
Oct 30 13:57:30 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:57:30 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:57:30 user nova-compute[74319]:   <metadata>
Oct 30 13:57:30 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:57:30 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1548470189</nova:name>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:57:30</nova:creationTime>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:57:30 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:57:30 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:owner>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:user uuid="f860f101c5034c638821e668d33eeeff">tempest-AttachVolumeNegativeTest-1763755820-project-member</nova:user>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:project uuid="ee6fce9483d048b580da3d18df44316d">tempest-AttachVolumeNegativeTest-1763755820</nova:project>
Oct 30 13:57:30 user nova-compute[74319]:       </nova:owner>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:57:30 user nova-compute[74319]:       <nova:ports>
Oct 30 13:57:30 user nova-compute[74319]:         <nova:port uuid="d249fb65-92e3-468f-a94f-8a97f66d95c1">
Oct 30 13:57:30 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 13:57:30 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:30 user nova-compute[74319]:       </nova:ports>
Oct 30 13:57:30 user nova-compute[74319]:     </nova:instance>
Oct 30 13:57:30 user nova-compute[74319]:   </metadata>
Oct 30 13:57:30 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:57:30 user nova-compute[74319]:     <system>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="serial">cf3fa11e-80b3-431c-945a-0ab17f07c5b3</entry>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="uuid">cf3fa11e-80b3-431c-945a-0ab17f07c5b3</entry>
Oct 30 13:57:30 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:57:30 user nova-compute[74319]:     </system>
Oct 30 13:57:30 user nova-compute[74319]:   </sysinfo>
Oct 30 13:57:30 user nova-compute[74319]:   <os>
Oct 30 13:57:30 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:57:30 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:57:30 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:57:30 user nova-compute[74319]:   </os>
Oct 30 13:57:30 user nova-compute[74319]:   <features>
Oct 30 13:57:30 user nova-compute[74319]:     <acpi/>
Oct 30 13:57:30 user nova-compute[74319]:     <apic/>
Oct 30 13:57:30 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:57:30 user nova-compute[74319]:   </features>
Oct 30 13:57:30 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:57:30 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:57:30 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:57:30 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:57:30 user nova-compute[74319]:   </clock>
Oct 30 13:57:30 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:57:30 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:57:30 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:57:30 user nova-compute[74319]:   </cpu>
Oct 30 13:57:30 user nova-compute[74319]:   <devices>
Oct 30 13:57:30 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:57:30 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:57:30 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk"/>
Oct 30 13:57:30 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:57:30 user nova-compute[74319]:     </disk>
Oct 30 13:57:30 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:30 user nova-compute[74319]:       <mac address="fa:16:3e:78:cd:94"/>
Oct 30 13:57:30 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:30 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:30 user nova-compute[74319]:       <target dev="tapd249fb65-92"/>
Oct 30 13:57:30 user nova-compute[74319]:     </interface>
Oct 30 13:57:30 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:57:30 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/console.log" append="off"/>
Oct 30 13:57:30 user nova-compute[74319]:     </serial>
Oct 30 13:57:30 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:57:30 user nova-compute[74319]:     <video>
Oct 30 13:57:30 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:30 user nova-compute[74319]:     </video>
Oct 30 13:57:30 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:57:30 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:57:30 user nova-compute[74319]:     </rng>
Oct 30 13:57:30 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:57:30 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:57:30 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:57:30 user nova-compute[74319]:     </memballoon>
Oct 30 13:57:30 user nova-compute[74319]:   </devices>
Oct 30 13:57:30 user nova-compute[74319]: </domain>
Oct 30 13:57:30 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548470189',display_name='tempest-AttachVolumeNegativeTest-server-1548470189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548470189',id=11,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKZXvpqeVJ2cQHBORJmeu5dRHswoGJaHzxRZu3PiViY5yYJnBja5K9fT3zZh9f/pczAT6w35cLvvVGd+eY2hW8Js7G6goqExMRorPboyM/tKvmuVXaJ9wQdCfQfxBgOPA==',key_name='tempest-keypair-1014163901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40pt251u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:57:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=cf3fa11e-80b3-431c-945a-0ab17f07c5b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG os_vif [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '21737011-875b-5e82-9efd-688ab12222d6', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd249fb65-92, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd249fb65-92, col_values=(('qos', UUID('a869c9eb-3487-4f5e-bd96-b7b5f0e37bbe')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd249fb65-92, col_values=(('external_ids', {'iface-id': 'd249fb65-92e3-468f-a94f-8a97f66d95c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:cd:94', 'vm-uuid': 'cf3fa11e-80b3-431c-945a-0ab17f07c5b3'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:30 user nova-compute[74319]: INFO os_vif [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92')
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:78:cd:94, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updated VIF entry in instance network info cache for port d249fb65-92e3-468f-a94f-8a97f66d95c1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updating instance_info_cache with network_info: [{"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:57:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-89642627-a5b7-4757-8e17-6d769cccba01 req-81c6fb0f-3d8a-49fa-9ae9-2e234f00566b service nova] Releasing lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] No waiting events found dispatching network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:31 user nova-compute[74319]: WARNING nova.compute.manager [req-627fc1a6-cc72-4cb6-82fd-1ff12b970d7f req-ca9e3ae2-b3d3-4113-9d4e-2bc6b572291f service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received unexpected event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 for instance with vm_state building and task_state spawning.
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:57:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Instance spawned successfully.
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:33 user nova-compute[74319]: INFO nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Took 5.22 seconds to spawn the instance on the hypervisor.
Oct 30 13:57:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] No waiting events found dispatching network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:34 user nova-compute[74319]: WARNING nova.compute.manager [req-f8cca745-3a39-4aac-a348-4ea3e7528623 req-90bdd0ff-91d2-4c21-abe6-1021e9ac6767 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received unexpected event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 for instance with vm_state building and task_state spawning.
Oct 30 13:57:34 user nova-compute[74319]: INFO nova.compute.manager [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Took 6.01 seconds to build instance.
Oct 30 13:57:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-96e4b9e0-9d02-458d-b02f-97960d466459 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.113s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:37 user nova-compute[74319]: INFO nova.compute.manager [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Attaching volume 1a3fe339-609d-4bd8-9e77-a2b811a31fd4 to /dev/sdc
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0074cc8d-8650-4708-8467-8bbdbdca590d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f856e7b-6ef8-4ae8-89aa-fa0cbba0b762]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fca19d-89e2-45fd-aca2-e194fb445cc8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b017bae9-44bc-4d99-8d2c-ceefe7ddf42f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:38 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7240cdee-d06c-46fd-988b-e17703e8aaaf]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.utils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating existing volume attachment record: 47e21b6a-5465-41a0-b3a4-16fdbdff6038 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:57:38 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Creating image(s)
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Ensure instance console log exists: /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Start _get_guest_xml network_info=[{"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '911172a1-bb3d-4a8d-9deb-5ab8b4a72063', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljzFXItc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c', 'attached_at': '', 'detached_at': '', 'volume_id': '6abbac29-245b-41c6-a8ae-c612a411e37a', 'serial': '6abbac29-245b-41c6-a8ae-c612a411e37a'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': '1848139a-8d70-4f9d-bbe9-b875a98bc190', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mncUKeWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c', 'attached_at': '', 'detached_at': '', 'volume_id': 'f61580e2-fad5-45ba-af71-d69ab8f62c5e', 'serial': 'f61580e2-fad5-45ba-af71-d69ab8f62c5e'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': '2118db7a-93e2-42ff-9a95-a4a29ffd54d2', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZDhuaLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c', 'attached_at': '', 'detached_at': '', 'volume_id': '8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 'serial': '8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:57:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljzFXItc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:38 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:38 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:38 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4e0f6-08bc-423a-92d5-83aa02801ba2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:38 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d41c77d-9a0a-42b7-85d1-96cda96cc5c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a] added
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[652fc5c5-a4aa-4d72-8680-1892c85b1368]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8cf018a-2e67-4480-ad2f-b3007e112f83]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljzFXItc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ljzFXItc" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c337f3ab-fa67-41ce-a90c-47bceba7a0a6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ljzFXItc'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[748d8a3a-2e2a-4c0d-8b39-a5d7c95cc480]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[473523b2-76b1-492f-aa27-c288d5502368]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: INFO nova.compute.manager [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Rebuilding instance
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe025d3-edea-4f56-ae99-6c0c1a414df2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260]
Oct 30 13:57:38 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0e132-4086-4531-afdb-b1fa56606fd7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[41548b44-74e8-4a2f-87d1-5410cdb82372]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:38 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e3a551-3439-4199-ad93-347e70b85e03]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljzFXItc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] volume_snapshot_create: create_info: {'snapshot_id': '35748d01-9c17-4624-8412-6131a40bbc37', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74319) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] snap xml: <domainsnapshot>
Oct 30 13:57:39 user nova-compute[74319]:   <disks>
Oct 30 13:57:39 user nova-compute[74319]:     <disk name="/dev/sde" snapshot="external" type="file">
Oct 30 13:57:39 user nova-compute[74319]:       <source file="/dev/new_file"/>
Oct 30 13:57:39 user nova-compute[74319]:     </disk>
Oct 30 13:57:39 user nova-compute[74319]:     <disk name="vda" snapshot="no"/>
Oct 30 13:57:39 user nova-compute[74319]:   </disks>
Oct 30 13:57:39 user nova-compute[74319]: </domainsnapshot>
Oct 30 13:57:39 user nova-compute[74319]:  {{(pid=74319) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] Lazy-loading 'system_metadata' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0ea3d1b4-b05e-41f8-985f-69f7e4ce2984 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] volume_snapshot_delete: delete_info: {'volume_id': 'a8452969-d0a2-4506-a2d9-8b1a71afc389'} {{(pid=74319) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [None req-0ea3d1b4-b05e-41f8-985f-69f7e4ce2984 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Traceback (most recent call last):
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     if delete_info['type'] != 'qcow2':
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] KeyError: 'type'
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] 
Oct 30 13:57:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Traceback (most recent call last):
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     rv = execute(f, *args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     six.reraise(c, e, tb)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     raise value
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     rv = meth(*args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] 
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Traceback (most recent call last):
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     self._volume_snapshot_create(context, instance, guest,
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     rv = execute(f, *args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     six.reraise(c, e, tb)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     raise value
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     rv = meth(*args, **kwargs)
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:39 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] 
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-vif-unplugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] No waiting events found dispatching network-vif-unplugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:39 user nova-compute[74319]: WARNING nova.compute.manager [req-e9c8615b-913e-4d2f-b6b0-2d2da75bf968 req-d00c760d-f493-4956-94dc-30712729d95c service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received unexpected event network-vif-unplugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e for instance with vm_state active and task_state rebuilding.
Oct 30 13:57:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance destroyed successfully.
Oct 30 13:57:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance destroyed successfully.
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1279271681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904580473',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZamBmUkUghkSL/oO2f7Dmvtu1DvtJs7O6EIiD+2htZ6cPI2j/H+wmBiWZod4ZFO/LHmgTlAL0JbCLWEshjXSJ4gRIVx4HKrU3cNmOkCr+z/W8UAkgM6yxYqbgXZNSCgw==',key_name='tempest-keypair-1468331112',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a57ddfde4dc84a5ba386188705391e4d',ramdisk_id='',reservation_id='r-5sca1jmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1977745252',owner_user_name='tempest-ServerActionsV293TestJSON-1977745252-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2eed42254fc948d7a606fe240672ec01',uuid=67280b94-8d8c-47ce-800d-a88d7de8e3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converting VIF {"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:39 user nova-compute[74319]: DEBUG os_vif [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.768s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== connect_volume: return (1770ms) {'type': 'block', 'scsi_wwn': '23462346339373165', 'path': '/dev/sdf'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462346339373165', 'path': '/dev/sdf'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24cf35b1-7e, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=873c210c-aac0-4682-9162-4d4f42df7e7f) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:40 user nova-compute[74319]: INFO os_vif [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e')
Oct 30 13:57:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:40 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mncUKeWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:40 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eadbd3-e5f2-434c-9968-e2f50ca721c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:57:40 user nova-compute[74319]: No targets found.
Oct 30 13:57:40 user nova-compute[74319]: iSNS:
Oct 30 13:57:40 user nova-compute[74319]: No targets found.
Oct 30 13:57:40 user nova-compute[74319]: STATIC:
Oct 30 13:57:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:57:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:57:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:57:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:57:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:57:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:57:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:57:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:57:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:57:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389
Oct 30 13:57:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:57:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:57:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05
Oct 30 13:57:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:57:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:57:40 user nova-compute[74319]: FIRMWARE:
Oct 30 13:57:40 user nova-compute[74319]: No targets found.
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:57:40 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:57:40 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429bc67-cf53-41c9-91cd-41255dae869d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd58b9b-2e36-40fa-8f27-d7df6aeaff13]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99837de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e9a338-a3b7-42c9-80b4-44be69f269f5]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7dd2c3-1594-4975-b587-d4efd4bb94bd]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8973b3df-8dc7-492f-a669-f7b375eee8a0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7dceea-842f-4631-9d05-a047e200fe9e]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dca053-e6bc-4c44-b0e0-c125e35f6f6e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b71734-145c-4136-9b51-2bbd6eb6bbf2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260]
Oct 30 13:57:40 user nova-compute[74319]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95caa2-1fa1-4bf3-8967-964b235b4097]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] <== disconnect_volume: return (343ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:57:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Deleting instance files /opt/stack/data/nova/instances/67280b94-8d8c-47ce-800d-a88d7de8e3d3_del
Oct 30 13:57:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Deletion of /opt/stack/data/nova/instances/67280b94-8d8c-47ce-800d-a88d7de8e3d3_del complete
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.327s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:40 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:40 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2095a325-33d6-45a5-aba6-6510b4c77d66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:40 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf864b67-c2c0-4681-bc7a-5528bc7599c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e] added
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a0c79b-16f7-43eb-9854-f4279df75c88]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74319) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 30 13:57:40 user nova-compute[74319]: INFO nova.virt.libvirt.host [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] UEFI support detected
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5cfc9c4-f198-403e-b5e0-0677187f25b2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mncUKeWu {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mncUKeWu" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e074e3-2268-45d2-a3cd-891558d97611]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mncUKeWu'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[54525a52-7714-4710-96c0-d09fd17de290]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05be36-9f13-43ce-97e3-096799ffde3f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[da99853b-7013-44fd-b14d-755634506255]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260]
Oct 30 13:57:40 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c120573-d09d-4b19-8623-6ed16958f935]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9669221-0a7f-441a-a456-29fb5599f299]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:40 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17435d7-dc6b-465e-8baa-d651082b803c]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mncUKeWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] No waiting events found dispatching network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:41 user nova-compute[74319]: WARNING nova.compute.manager [req-163359a0-abd6-4eff-b85e-b97e96625a97 req-3aff7c11-012d-4a41-bb09-8b12c9d84787 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received unexpected event network-vif-plugged-24cf35b1-7eee-4873-b57a-8a04d0f7377e for instance with vm_state active and task_state rebuilding.
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== connect_volume: return (1676ms) {'type': 'block', 'scsi_wwn': '23436333338373063', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436333338373063', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZDhuaLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:42 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf4e895-41bd-45dd-91bb-0e3dc7b1de72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:42 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c6201-6506-4093-9cac-84685f29ee99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9] added
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[28524e3d-3b2e-43b4-bf79-3cd4e762d90c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6146a529-9b83-49e4-a519-8bac29e9f600]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZDhuaLz {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MZDhuaLz" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429dc3c-3e4a-4fe6-bbd6-686fd4a3a3f6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MZDhuaLz'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b16cc53-d907-45f3-a6f7-850d4b56b8e5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d52964-452c-405b-beb7-688a751262c6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[430a2605-e901-4e38-924c-35c8a188892c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260]
Oct 30 13:57:42 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc131762-513d-4132-913c-98d57e62b0e8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[faee8508-2b15-4006-8287-befe7fa58764]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:42 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a35347a-2576-424b-a236-732d51f35b2f]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaPbpdOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.utils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69bb3b7-c2c1-4575-a413-50c584228da4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7476730-832d-4fd1-8e63-10260c3f1f9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b06203-29a9-417a-8e7b-d08c4f9ab18e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[723243b1-22f4-4796-a4a3-0187b1d1c936]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:57:42 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:57:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca255967-58f6-4ddb-9a09-e2615807d841]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG os_brick.utils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:42 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating existing volume attachment record: 216f7935-3601-4873-b5b9-83198882ae01 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [None req-0ea3d1b4-b05e-41f8-985f-69f7e4ce2984 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e65ba756-5a3b-42c0-a461-25daedde3cfe)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 30 13:57:42 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server [None req-0ea3d1b4-b05e-41f8-985f-69f7e4ce2984 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] Exception during message handling: KeyError: 'type'
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 30 13:57:42 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 35748d01-9c17-4624-8412-6131a40bbc37 could not be found.
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise value
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 35748d01-9c17-4624-8412-6131a40bbc37 could not be found. (HTTP 404) (Request-ID: req-809554f3-666c-4285-b8b0-c543c21557d8)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 35748d01-9c17-4624-8412-6131a40bbc37 could not be found.
Oct 30 13:57:43 user nova-compute[74319]: ERROR nova.virt.libvirt.driver 
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server [None req-9005e47d-61c5-4ced-911e-926b68c20084 tempest-VolumesAssistedSnapshotsTest-1250384670 tempest-VolumesAssistedSnapshotsTest-1250384670-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise value
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 30 13:57:43 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZDhuaLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23235653037643036', 'path': '/dev/sdg'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653037643036', 'path': '/dev/sdg'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.838s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6c1835-2e56-446b-b300-2ca089fddab5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:57:43 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lazy-loading 'pci_devices' on Instance uuid ea67d25b-9010-4f0a-bf43-9e2483cc859c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d71f736-3fdd-4ba8-9ec3-0bf8a51616f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464] added
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:57:43 user nova-compute[74319]:   <uuid>ea67d25b-9010-4f0a-bf43-9e2483cc859c</uuid>
Oct 30 13:57:43 user nova-compute[74319]:   <name>instance-0000000a</name>
Oct 30 13:57:43 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:57:43 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:57:43 user nova-compute[74319]:   <metadata>
Oct 30 13:57:43 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:57:43 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:name>tempest-device-tagging-server-1625945478</nova:name>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:57:38</nova:creationTime>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:57:43 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:57:43 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:owner>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:user uuid="0383d20b22434a7fb704e65226cf66ce">tempest-TaggedBootDevicesTest-1140656183-project-member</nova:user>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:project uuid="c4b92b41eede4ba1873ca7c4574d31e5">tempest-TaggedBootDevicesTest-1140656183</nova:project>
Oct 30 13:57:43 user nova-compute[74319]:       </nova:owner>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:57:43 user nova-compute[74319]:       <nova:ports>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="f2757f95-16d0-4e3b-9696-adb3c8920856">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="2eab49af-373e-46f0-91d9-d842b75b8d3f">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="5fe430f4-ccb6-40c5-b161-b05ef94daeb4">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.118" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="4d9f1aac-73a6-4a38-b55f-a1b07d6302d0">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:         <nova:port uuid="f75f6f1a-cf5c-4f98-8391-a0f12a825252">
Oct 30 13:57:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 13:57:43 user nova-compute[74319]:         </nova:port>
Oct 30 13:57:43 user nova-compute[74319]:       </nova:ports>
Oct 30 13:57:43 user nova-compute[74319]:     </nova:instance>
Oct 30 13:57:43 user nova-compute[74319]:   </metadata>
Oct 30 13:57:43 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:57:43 user nova-compute[74319]:     <system>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="serial">ea67d25b-9010-4f0a-bf43-9e2483cc859c</entry>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="uuid">ea67d25b-9010-4f0a-bf43-9e2483cc859c</entry>
Oct 30 13:57:43 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:57:43 user nova-compute[74319]:     </system>
Oct 30 13:57:43 user nova-compute[74319]:   </sysinfo>
Oct 30 13:57:43 user nova-compute[74319]:   <os>
Oct 30 13:57:43 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:57:43 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:57:43 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:57:43 user nova-compute[74319]:   </os>
Oct 30 13:57:43 user nova-compute[74319]:   <features>
Oct 30 13:57:43 user nova-compute[74319]:     <acpi/>
Oct 30 13:57:43 user nova-compute[74319]:     <apic/>
Oct 30 13:57:43 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:57:43 user nova-compute[74319]:   </features>
Oct 30 13:57:43 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:57:43 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:57:43 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:57:43 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:57:43 user nova-compute[74319]:   </clock>
Oct 30 13:57:43 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:57:43 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:57:43 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:57:43 user nova-compute[74319]:   </cpu>
Oct 30 13:57:43 user nova-compute[74319]:   <devices>
Oct 30 13:57:43 user nova-compute[74319]:     <disk type="file" device="cdrom">
Oct 30 13:57:43 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 13:57:43 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/disk.config"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="hda" bus="ide"/>
Oct 30 13:57:43 user nova-compute[74319]:     </disk>
Oct 30 13:57:43 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:57:43 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:43 user nova-compute[74319]:       <source dev="/dev/sdf"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <serial>6abbac29-245b-41c6-a8ae-c612a411e37a</serial>
Oct 30 13:57:43 user nova-compute[74319]:     </disk>
Oct 30 13:57:43 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:57:43 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:43 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <serial>f61580e2-fad5-45ba-af71-d69ab8f62c5e</serial>
Oct 30 13:57:43 user nova-compute[74319]:     </disk>
Oct 30 13:57:43 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:57:43 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:43 user nova-compute[74319]:       <source dev="/dev/sdg"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="vdc" bus="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <serial>8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9</serial>
Oct 30 13:57:43 user nova-compute[74319]:     </disk>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:35:28:35"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tapf2757f95-16"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:18:4f:98"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tap1989ad9e-b3"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:6f:ab:5d"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tap2eab49af-37"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:f9:5c:4e"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tap5fe430f4-cc"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:66:5a:c8"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tap4d9f1aac-73"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:ec:2a:a2"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tap8b6dbaf0-9d"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:57:43 user nova-compute[74319]:       <mac address="fa:16:3e:8e:b9:f7"/>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:57:43 user nova-compute[74319]:       <target dev="tapf75f6f1a-cf"/>
Oct 30 13:57:43 user nova-compute[74319]:     </interface>
Oct 30 13:57:43 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:57:43 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/console.log" append="off"/>
Oct 30 13:57:43 user nova-compute[74319]:     </serial>
Oct 30 13:57:43 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:57:43 user nova-compute[74319]:     <video>
Oct 30 13:57:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:57:43 user nova-compute[74319]:     </video>
Oct 30 13:57:43 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:57:43 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:57:43 user nova-compute[74319]:     </rng>
Oct 30 13:57:43 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:57:43 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:57:43 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:57:43 user nova-compute[74319]:     </memballoon>
Oct 30 13:57:43 user nova-compute[74319]:   </devices>
Oct 30 13:57:43 user nova-compute[74319]: </domain>
Oct 30 13:57:43 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fdee6ba-9634-5f88-976f-15290063e564', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dc6eba-7f44-481c-a518-841b3404d0a4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2757f95-16, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2757f95-16, col_values=(('qos', UUID('d8bbc707-aa00-4702-839b-72d373da4023')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2757f95-16, col_values=(('external_ids', {'iface-id': 'f2757f95-16d0-4e3b-9696-adb3c8920856', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:35:28:35', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16')
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d80a03-b1b1-4983-9af0-7f29230b8739]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73273bc7-daeb-5657-9442-dc30ec29d85e', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaPbpdOn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1989ad9e-b3, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1989ad9e-b3, col_values=(('qos', UUID('9136139c-3bce-47e4-a7c0-c3f5f225af7c')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1989ad9e-b3, col_values=(('external_ids', {'iface-id': '1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:4f:98', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JaPbpdOn" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[636feb31-4872-44df-a26f-c630f6d2f192]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JaPbpdOn'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3')
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[895ca740-df36-4997-98b9-9e1ce460d83f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3da4481b-79f0-5ca6-b496-26d18d5cf94c', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eab49af-37, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2eab49af-37, col_values=(('qos', UUID('3c7a4086-b60f-414f-b4ae-aea7d9ded5ad')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2eab49af-37, col_values=(('external_ids', {'iface-id': '2eab49af-373e-46f0-91d9-d842b75b8d3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:ab:5d', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f191d4e-64a6-4763-a16b-df376b8179c9]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37')
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '40ceb81f-5dd3-566d-955c-7c3aadc25263', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fe430f4-cc, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fe430f4-cc, col_values=(('qos', UUID('dd41e4aa-4ac4-491f-85b0-36d11b570107')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fe430f4-cc, col_values=(('external_ids', {'iface-id': '5fe430f4-ccb6-40c5-b161-b05ef94daeb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:5c:4e', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c9c2ba-8fec-45e8-856e-f25f4309540e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260]
Oct 30 13:57:43 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260] successful.
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc')
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd774e03-7ea7-44ae-bce9-07fdc7d002f7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c477a89-149e-5430-b21a-027e793d81d8', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1476b7b1-08fc-4795-9775-b306c0a06cec]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:57:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.408s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e732f06-70ab-42d7-8c51-a9bc6a59fa54]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaPbpdOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d9f1aac-73, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d9f1aac-73, col_values=(('qos', UUID('f29ba84f-f010-44f3-a815-ec10531d25de')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d9f1aac-73, col_values=(('external_ids', {'iface-id': '4d9f1aac-73a6-4a38-b55f-a1b07d6302d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:5a:c8', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73')
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '756377f9-84dd-5796-a774-5c2ff0b2d639', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b6dbaf0-9d, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b6dbaf0-9d, col_values=(('qos', UUID('16baf0e0-8310-4fa4-9f9e-2d6c955872e2')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b6dbaf0-9d, col_values=(('external_ids', {'iface-id': '8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:2a:a2', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d')
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d8621df-bb75-576e-9920-c77afb046450', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf75f6f1a-cf, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf75f6f1a-cf, col_values=(('qos', UUID('33160d25-7405-4c29-bbd5-f02b88853157')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf75f6f1a-cf, col_values=(('external_ids', {'iface-id': 'f75f6f1a-cf5c-4f98-8391-a0f12a825252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:b9:f7', 'vm-uuid': 'ea67d25b-9010-4f0a-bf43-9e2483cc859c'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:44 user nova-compute[74319]: INFO os_vif [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf')
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] No BDM found with device name hda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] No VIF found with MAC fa:16:3e:35:28:35, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] No VIF found with MAC fa:16:3e:66:5a:c8, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:44 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Using config drive
Oct 30 13:57:44 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Creating config drive at /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/disk.config
Oct 30 13:57:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpahx08i7d {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpahx08i7d" returned: 0 in 0.059s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] <== connect_volume: return (2282ms) {'type': 'block', 'scsi_wwn': '26639633130333066', 'path': '/dev/sdh'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639633130333066', 'path': '/dev/sdh'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:57:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 13:57:44 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:57:44 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 13:57:44 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:57:44 user nova-compute[74319]:   <serial>fb8d7bf4-00d2-4e1f-b5c6-53c80a895464</serial>
Oct 30 13:57:44 user nova-compute[74319]: </disk>
Oct 30 13:57:44 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:57:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No BDM found with device name hda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:57:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] No VIF found with MAC fa:16:3e:ea:e3:d4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:46 user nova-compute[74319]: WARNING nova.compute.manager [req-f0ba31b7-76a0-4aa1-b1a3-09b0dc4198cc req-280ce8ad-c0fc-4501-8727-4d6045cbeded service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 for instance with vm_state building and task_state spawning.
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:47 user nova-compute[74319]: WARNING nova.compute.manager [req-256d22b8-cc3c-4dad-819a-223f7d9dcb71 req-fe2a9470-4b9b-434e-be09-4ab96827396b service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 for instance with vm_state building and task_state spawning.
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:48 user nova-compute[74319]: WARNING nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 for instance with vm_state building and task_state spawning.
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:48 user nova-compute[74319]: WARNING nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f for instance with vm_state building and task_state spawning.
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:48 user nova-compute[74319]: WARNING nova.compute.manager [req-015e57dc-9652-44a2-a1e9-b8f1afcada8d req-2c8f250c-c6dd-4eae-9f27-8b9eb85c97bc service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:49 user nova-compute[74319]: WARNING nova.compute.manager [req-742d99a4-95f7-484f-aae7-5535bf7367be req-476c4008-5dec-484c-970d-5bbaa08722cf service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 for instance with vm_state building and task_state spawning.
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:50 user nova-compute[74319]: WARNING nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 for instance with vm_state building and task_state spawning.
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:57:50 user nova-compute[74319]: WARNING nova.compute.manager [req-35e248fe-a1d7-4947-81d3-8f031cfb0ba2 req-cc55fdb1-c954-4273-8ed7-555dab92016d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 for instance with vm_state building and task_state spawning.
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:57:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance spawned successfully.
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:57:50 user nova-compute[74319]: INFO nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Took 12.59 seconds to spawn the instance on the hypervisor.
Oct 30 13:57:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:57:51 user nova-compute[74319]: INFO nova.compute.manager [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Took 102.98 seconds to build instance.
Oct 30 13:57:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c6c6cad5-81ea-4012-a359-a3f98018ec54 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 103.183s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:57:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:57:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GglYFDLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:06 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:06 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:06 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d2cd46-cf55-4f10-a33f-7b62ffe71b71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:06 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[113ff797-3e1f-4cc0-a62c-3d98cdaf6bd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4] added
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e246204-624d-43a5-b5de-101d6e6bd6dc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[12559310-4ef0-4056-8412-f29f5ffb7911]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GglYFDLn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GglYFDLn" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbcf63d-3a27-4ed9-9e16-8bd146dc6b74]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GglYFDLn'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 could not be found.
Oct 30 13:58:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:06 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc558ef0-cae3-44c4-93dd-d7f8dbfda644]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7aadd7-7992-4f7e-b8e3-417ee175cddc]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[116288d8-aabe-44ba-a960-38dfe5115dee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260]
Oct 30 13:58:06 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673e925-5571-4079-b472-a5e79eaa1684]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[facf2283-71ca-4063-aba1-e69c3c5ef031]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a534e8f-4b13-4d8f-8174-3b29f74e6209]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GglYFDLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f9ef76f-a9bf-4bf1-b4bb-0d53444f93db tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 70.618s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:07 user nova-compute[74319]: INFO nova.compute.manager [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Detaching volume a8452969-d0a2-4506-a2d9-8b1a71afc389
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.utils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a29148c-9361-4e1a-b6c1-1b39ee742891]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG nova.objects.instance [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lazy-loading 'flavor' on Instance uuid bb5d67f1-e3ef-41ae-94f1-29c29eb30388 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:07 user nova-compute[74319]: INFO nova.virt.block_device [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Attempting to driver detach volume a8452969-d0a2-4506-a2d9-8b1a71afc389 from mountpoint /dev/vdb
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c8be2-d52f-4b4c-ace6-908713bc413f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Attempting to detach device vdb from instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:07 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:07 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 13:58:07 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:07 user nova-compute[74319]:   <serial>a8452969-d0a2-4506-a2d9-8b1a71afc389</serial>
Oct 30 13:58:07 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:58:07 user nova-compute[74319]: </disk>
Oct 30 13:58:07 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:07 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Successfully detached device vdb from instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c from the persistent domain config.
Oct 30 13:58:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:07 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:07 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 13:58:07 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:07 user nova-compute[74319]:   <serial>a8452969-d0a2-4506-a2d9-8b1a71afc389</serial>
Oct 30 13:58:07 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:58:07 user nova-compute[74319]: </disk>
Oct 30 13:58:07 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68091ad-ad05-4bf4-a6ec-40f151444649]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cbbc49-e45e-43c5-a40e-29bfab0e7558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:07 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:58:07 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cafdfa-1950-445b-b6b9-8f431ea45b46]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:58:07 user nova-compute[74319]: DEBUG os_brick.utils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23461616634383634', 'path': '/dev/sdi'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461616634383634', 'path': '/dev/sdi'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.232s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:08 user nova-compute[74319]: INFO nova.compute.manager [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Attaching volume 83717a0f-9ece-49b5-af2c-383e9843ce6a to /dev/vdb
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3c945-f4ce-4aa7-bf5f-2fbf99a5be98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:08 user nova-compute[74319]: No targets found.
Oct 30 13:58:08 user nova-compute[74319]: iSNS:
Oct 30 13:58:08 user nova-compute[74319]: No targets found.
Oct 30 13:58:08 user nova-compute[74319]: STATIC:
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4
Oct 30 13:58:08 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:08 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:08 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:08 user nova-compute[74319]: No targets found.
Oct 30 13:58:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:08 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:08 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:08 user nova-compute[74319]: INFO nova.compute.manager [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Swapping volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159 for 6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.objects.instance [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lazy-loading 'flavor' on Instance uuid 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea481fb-2511-4cbf-9287-68680fa3afb1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 13:58:08 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:08 user nova-compute[74319]:   <source dev="/dev/sdi"/>
Oct 30 13:58:08 user nova-compute[74319]:   <target dev="sdc" bus="scsi"/>
Oct 30 13:58:08 user nova-compute[74319]:   <serial>1a3fe339-609d-4bd8-9e77-a2b811a31fd4</serial>
Oct 30 13:58:08 user nova-compute[74319]:   <address type="drive" controller="0" unit="2"/>
Oct 30 13:58:08 user nova-compute[74319]: </disk>
Oct 30 13:58:08 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.047s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[43340b43-07fa-4ec1-89f6-0b31808f0a8f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a017dcf0>, {}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Disconnecting from: [] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.118s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] <== disconnect_volume: return (1351ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No BDM found with device name sda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] No VIF found with MAC fa:16:3e:77:12:ff, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:58:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyYtKjPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:12 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:12 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:12 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eefa4f-653e-4642-ab45-da7a1a28ef98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:12 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbdcb96-b97f-46cc-b3f7-7e4af36e167d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171] added
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4524a0-945b-4880-b8f0-cdb2f12e68cf]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a4db0f-86ee-4d41-b11c-91f80e2f25fe]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyYtKjPX {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NyYtKjPX" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[123be5b5-c9ea-4e26-b5c6-04d8f4c23cf7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NyYtKjPX'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5ae1d9-410a-472b-9770-70781dfc104d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.utils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bf3284-3024-446b-89e9-5fea34e2f556]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c6561f-b5d1-4027-b503-39947d7ba1d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bca4d7f-0ecb-4771-8f0f-e3d4eeab7579]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87d9297-3901-4f68-bf09-73bd0d988960]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed08a3e-fe45-4876-9823-9465eeac1d67]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:12 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051ca67-fc0c-49cb-9977-291f07251412]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.utils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating existing volume attachment record: 66a93f69-b51a-4f09-a3e2-7d656176f61b {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --login" returned: 0 in 0.109s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2bf5d4-5002-4928-be8c-e3250c4209e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260]
Oct 30 13:58:12 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e08d06-1ff1-4fc6-8edd-09ddff0d7e98]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-08da2a93-49ae-4912-a08e-5ab85491a076 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.179s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9c514a-c8ec-4d57-b74e-10d8d485b6f4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.409s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.069s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbe831-c14e-4f26-9cd4-cf7ed8ea1741]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyYtKjPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:58:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Creating image(s)
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Ensure instance console log exists: /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Start _get_guest_xml network_info=[{"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '968d3c51-0e93-4743-8135-0fca93666e5d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxjZcotY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fae7c1c-745c-41b6-a682-c40e6d507b0d', 'attached_at': '', 'detached_at': '', 'volume_id': 'd96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 'serial': 'd96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'attachment_id': 'aed0341d-5b42-4dd7-96e6-1b9b92f9c814', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhsigoud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fae7c1c-745c-41b6-a682-c40e6d507b0d', 'attached_at': '', 'detached_at': '', 'volume_id': '7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 'serial': '7ef92531-9ece-46b1-a8dd-64a5e12f7e29'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'attachment_id': '47e21b6a-5465-41a0-b3a4-16fdbdff6038', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGEsCOYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4fae7c1c-745c-41b6-a682-c40e6d507b0d', 'attached_at': '', 'detached_at': '', 'volume_id': '6dd7e3a6-c5b7-423e-a409-af6153226c08', 'serial': '6dd7e3a6-c5b7-423e-a409-af6153226c08'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:58:13 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:58:13 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxjZcotY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:13 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Preparing to wait for external event volume-reimaged-05e121ec-970e-4e6a-8701-36f0febdac05 {{(pid=74319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.509s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] <== connect_volume: return (1511ms) {'type': 'block', 'scsi_wwn': '23639643532356365', 'path': '/dev/sdj'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639643532356365', 'path': '/dev/sdj'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.550s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:14 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:14 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'flavor' on Instance uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0ba1c3-72b9-4c64-94b1-b8faf6169977]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:14 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 13:58:14 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:14 user nova-compute[74319]:   <source dev="/dev/sdj"/>
Oct 30 13:58:14 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:14 user nova-compute[74319]:   <serial>9ad4abce-a5b6-4de9-b6e3-849dc81c8171</serial>
Oct 30 13:58:14 user nova-compute[74319]: </disk>
Oct 30 13:58:14 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fd9b66-589b-438e-9310-ef414058675b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b] added
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[720630ca-a8db-41ed-9107-b74cb9f3df8f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe1ec0c-07ac-4168-a01a-f2a8f5a81d3e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxjZcotY {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxjZcotY" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54c473a-6c7a-4e1a-87ee-659a12fa77c4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxjZcotY'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f300ad-e9bc-4d8a-82b3-57964e7bbca2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c171a4b2-a0bf-4d28-9c93-4184fc600757]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c886aa4c-5665-4f6a-9fc5-6d596f68e8c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260]
Oct 30 13:58:14 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acab2c1-7c03-4d24-be12-83bc0bfbdc2c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37278fa-6ed6-41aa-b498-612df581ef1d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.065s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37eaeef-8495-411e-8463-37d17e85c7b8]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No VIF found with MAC fa:16:3e:da:1b:13, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:58:14 user nova-compute[74319]: INFO nova.compute.manager [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Detaching volume fb8d7bf4-00d2-4e1f-b5c6-53c80a895464
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1e2f1db2-9583-4f57-a5b0-7bc1941cc3b7 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 78.220s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:15 user nova-compute[74319]: INFO nova.virt.block_device [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Attempting to driver detach volume fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 from mountpoint /dev/vdb
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Attempting to detach device vdb from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:15 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:15 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 13:58:15 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:15 user nova-compute[74319]:   <serial>fb8d7bf4-00d2-4e1f-b5c6-53c80a895464</serial>
Oct 30 13:58:15 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 13:58:15 user nova-compute[74319]: </disk>
Oct 30 13:58:15 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully detached device vdb from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the persistent domain config.
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:15 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:15 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 13:58:15 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:15 user nova-compute[74319]:   <serial>fb8d7bf4-00d2-4e1f-b5c6-53c80a895464</serial>
Oct 30 13:58:15 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 13:58:15 user nova-compute[74319]: </disk>
Oct 30 13:58:15 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:15 user nova-compute[74319]: INFO nova.compute.manager [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Detaching volume 1a3fe339-609d-4bd8-9e77-a2b811a31fd4
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxjZcotY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== connect_volume: return (2047ms) {'type': 'block', 'scsi_wwn': '26232646631396165', 'path': '/dev/sdk'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232646631396165', 'path': '/dev/sdk'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhsigoud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:15 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:15 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:15 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: INFO nova.virt.block_device [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Attempting to driver detach volume 1a3fe339-609d-4bd8-9e77-a2b811a31fd4 from mountpoint /dev/sdc
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d034a5-0867-44b6-9e35-4bd6b6cc6b00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:15 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Attempting to detach device sdc from instance 4a623a60-8c92-4860-92a0-57b606be809a from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:15 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:15 user nova-compute[74319]:   <source dev="/dev/sdi"/>
Oct 30 13:58:15 user nova-compute[74319]:   <target dev="sdc" bus="scsi"/>
Oct 30 13:58:15 user nova-compute[74319]:   <serial>1a3fe339-609d-4bd8-9e77-a2b811a31fd4</serial>
Oct 30 13:58:15 user nova-compute[74319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 13:58:15 user nova-compute[74319]: </disk>
Oct 30 13:58:15 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Successfully detached device sdc from instance 4a623a60-8c92-4860-92a0-57b606be809a from the persistent domain config.
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 4a623a60-8c92-4860-92a0-57b606be809a from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:15 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:15 user nova-compute[74319]:   <source dev="/dev/sdi"/>
Oct 30 13:58:15 user nova-compute[74319]:   <target dev="sdc" bus="scsi"/>
Oct 30 13:58:15 user nova-compute[74319]:   <serial>1a3fe339-609d-4bd8-9e77-a2b811a31fd4</serial>
Oct 30 13:58:15 user nova-compute[74319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 30 13:58:15 user nova-compute[74319]: </disk>
Oct 30 13:58:15 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1952cf9-25fa-499e-b6a3-48621cdce0ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29] added
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbe6d76-4a4d-4d60-a265-4f64b3c478bc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e49f7-1494-4e11-8c52-58b98fc3c012]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhsigoud {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xhsigoud" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5c06b-d2a3-42e2-8880-d78ce1b930fb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xhsigoud'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e750526b-4189-4c7c-9f73-3767eae8401d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd645ee9-1d7f-426e-9698-21a30545d2e2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[66203c82-91bb-4a49-b293-f8faa7f7f69f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260]
Oct 30 13:58:15 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a03f4e-83a2-464a-862a-b323932cbf21]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccb6696-2489-41be-965f-3eb863567015]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21fe8ff-b210-4b78-a7ca-7cb96757c1b0]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:16 user nova-compute[74319]: INFO nova.compute.manager [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Detaching volume 9ad4abce-a5b6-4de9-b6e3-849dc81c8171
Oct 30 13:58:16 user nova-compute[74319]: INFO nova.virt.block_device [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Attempting to driver detach volume 9ad4abce-a5b6-4de9-b6e3-849dc81c8171 from mountpoint /dev/vdb
Oct 30 13:58:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Attempting to detach device vdb from instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:16 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:16 user nova-compute[74319]:   <source dev="/dev/sdj"/>
Oct 30 13:58:16 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:16 user nova-compute[74319]:   <serial>9ad4abce-a5b6-4de9-b6e3-849dc81c8171</serial>
Oct 30 13:58:16 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:58:16 user nova-compute[74319]: </disk>
Oct 30 13:58:16 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully detached device vdb from instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 from the persistent domain config.
Oct 30 13:58:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:58:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:58:16 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:16 user nova-compute[74319]:   <source dev="/dev/sdj"/>
Oct 30 13:58:16 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:58:16 user nova-compute[74319]:   <serial>9ad4abce-a5b6-4de9-b6e3-849dc81c8171</serial>
Oct 30 13:58:16 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:58:16 user nova-compute[74319]: </disk>
Oct 30 13:58:16 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhsigoud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '26662616264383163', 'path': '/dev/sdl'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662616264383163', 'path': '/dev/sdl'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGEsCOYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:17 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0a3d4-2b37-4626-8b02-87f6d9ecfa50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:17 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70f4f09-7a01-4224-9222-313973fafcfc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08] added
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7def8db3-1206-4de0-88d4-c9033da14ec1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd7000-ad36-47a7-94b6-fbfe07bd8f08]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGEsCOYp {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yGEsCOYp" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e51818-f9b4-427c-8a71-172cf6d0c305]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yGEsCOYp'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9b97eb-e5c3-4c50-8d53-6fd200a58ed0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[da239f46-2cbf-4b25-823c-38fe90264a02]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --login" returned: 0 in 0.126s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c08417-3f91-40ee-9249-21286becb9db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260]
Oct 30 13:58:17 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5398e0-2261-4b29-839e-28f4d8feb7f6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0956cec-9a1c-49d9-8ed1-0309fbc3c75a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.419s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] HCTL ('44', '-', '-', 0) found on session 14 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5a335c-cbb3-4c9e-93e9-6ab618db4aee]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Searching for a device in session 14 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGEsCOYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.470s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '23735346262396164', 'path': '/dev/sdm'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735346262396164', 'path': '/dev/sdm'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fae7c1c-745c-41b6-a682-c40e6d507b0d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:58:18 user nova-compute[74319]:   <uuid>4fae7c1c-745c-41b6-a682-c40e6d507b0d</uuid>
Oct 30 13:58:18 user nova-compute[74319]:   <name>instance-00000009</name>
Oct 30 13:58:18 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:58:18 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:58:18 user nova-compute[74319]:   <metadata>
Oct 30 13:58:18 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:58:18 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:name>tempest-device-tagging-server-1354532689</nova:name>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:58:13</nova:creationTime>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:58:18 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:58:18 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:owner>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:user uuid="ad3a7be151634bfd9316ddb7cc8fb716">tempest-TaggedBootDevicesTest_v242-631515063-project-member</nova:user>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:project uuid="f7f4d7b5d57b48bb99b757884cfb1e74">tempest-TaggedBootDevicesTest_v242-631515063</nova:project>
Oct 30 13:58:18 user nova-compute[74319]:       </nova:owner>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:58:18 user nova-compute[74319]:       <nova:ports>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="993d868c-2638-4168-9bcb-6aa370bb9258">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="da0ac42f-e842-4c4b-a7c8-690bd3679fab">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.178" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="78d89f62-5c8d-4037-8cc5-75197a31f61e">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.196" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="738547bc-e918-4ad8-9dd2-f200dee5daeb">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.1.1.31" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="bc01d474-0eab-48f5-841c-8fce27706c20">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:         <nova:port uuid="56c44b1b-00c2-47ce-b2a5-3a01ff177c59">
Oct 30 13:58:18 user nova-compute[74319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 30 13:58:18 user nova-compute[74319]:         </nova:port>
Oct 30 13:58:18 user nova-compute[74319]:       </nova:ports>
Oct 30 13:58:18 user nova-compute[74319]:     </nova:instance>
Oct 30 13:58:18 user nova-compute[74319]:   </metadata>
Oct 30 13:58:18 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:58:18 user nova-compute[74319]:     <system>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="serial">4fae7c1c-745c-41b6-a682-c40e6d507b0d</entry>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="uuid">4fae7c1c-745c-41b6-a682-c40e6d507b0d</entry>
Oct 30 13:58:18 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:58:18 user nova-compute[74319]:     </system>
Oct 30 13:58:18 user nova-compute[74319]:   </sysinfo>
Oct 30 13:58:18 user nova-compute[74319]:   <os>
Oct 30 13:58:18 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:58:18 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:58:18 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:58:18 user nova-compute[74319]:   </os>
Oct 30 13:58:18 user nova-compute[74319]:   <features>
Oct 30 13:58:18 user nova-compute[74319]:     <acpi/>
Oct 30 13:58:18 user nova-compute[74319]:     <apic/>
Oct 30 13:58:18 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:58:18 user nova-compute[74319]:   </features>
Oct 30 13:58:18 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:58:18 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:58:18 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:58:18 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:58:18 user nova-compute[74319]:   </clock>
Oct 30 13:58:18 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:58:18 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:58:18 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:58:18 user nova-compute[74319]:   </cpu>
Oct 30 13:58:18 user nova-compute[74319]:   <devices>
Oct 30 13:58:18 user nova-compute[74319]:     <disk type="file" device="cdrom">
Oct 30 13:58:18 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none"/>
Oct 30 13:58:18 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/disk.config"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="hda" bus="ide"/>
Oct 30 13:58:18 user nova-compute[74319]:     </disk>
Oct 30 13:58:18 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:58:18 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:18 user nova-compute[74319]:       <source dev="/dev/sdk"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <serial>d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b</serial>
Oct 30 13:58:18 user nova-compute[74319]:     </disk>
Oct 30 13:58:18 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:58:18 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:18 user nova-compute[74319]:       <source dev="/dev/sdl"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <serial>7ef92531-9ece-46b1-a8dd-64a5e12f7e29</serial>
Oct 30 13:58:18 user nova-compute[74319]:     </disk>
Oct 30 13:58:18 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 13:58:18 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:58:18 user nova-compute[74319]:       <source dev="/dev/sdm"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="vdc" bus="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <serial>6dd7e3a6-c5b7-423e-a409-af6153226c08</serial>
Oct 30 13:58:18 user nova-compute[74319]:     </disk>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:5c:a8:2d"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tap993d868c-26"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:3f:b9:af"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tapda0ac42f-e8"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:c7:60:f3"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tapb7b3aa7b-87"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:18:62:5e"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tap78d89f62-5c"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:e2:58:c1"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tap738547bc-e9"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:d6:aa:1a"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tapbc01d474-0e"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:58:18 user nova-compute[74319]:       <mac address="fa:16:3e:6d:f5:f2"/>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:58:18 user nova-compute[74319]:       <target dev="tap56c44b1b-00"/>
Oct 30 13:58:18 user nova-compute[74319]:     </interface>
Oct 30 13:58:18 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:58:18 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/console.log" append="off"/>
Oct 30 13:58:18 user nova-compute[74319]:     </serial>
Oct 30 13:58:18 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:58:18 user nova-compute[74319]:     <video>
Oct 30 13:58:18 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:58:18 user nova-compute[74319]:     </video>
Oct 30 13:58:18 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:58:18 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:58:18 user nova-compute[74319]:     </rng>
Oct 30 13:58:18 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:58:18 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:58:18 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:58:18 user nova-compute[74319]:     </memballoon>
Oct 30 13:58:18 user nova-compute[74319]:   </devices>
Oct 30 13:58:18 user nova-compute[74319]: </domain>
Oct 30 13:58:18 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1166e6a0-aaa0-5a1f-a313-041e62f4f738', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap993d868c-26, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap993d868c-26, col_values=(('qos', UUID('2aded9b5-91c6-4174-9d90-dada2c3c8a38')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap993d868c-26, col_values=(('external_ids', {'iface-id': '993d868c-2638-4168-9bcb-6aa370bb9258', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:a8:2d', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26')
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06ea4030-e028-5507-9884-0faa63fa7a7a', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda0ac42f-e8, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda0ac42f-e8, col_values=(('qos', UUID('56d61b88-66c7-4377-a21b-7bdfe3b28ea5')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda0ac42f-e8, col_values=(('external_ids', {'iface-id': 'da0ac42f-e842-4c4b-a7c8-690bd3679fab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:b9:af', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8')
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03d43c49-2778-5817-8151-60123c9cbf35', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7b3aa7b-87, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7b3aa7b-87, col_values=(('qos', UUID('5c29e3aa-745d-40d6-a992-e070bfaa02b3')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7b3aa7b-87, col_values=(('external_ids', {'iface-id': 'b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:60:f3', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87')
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '173f3d1d-59f1-564d-b506-d2e7f333d818', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78d89f62-5c, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78d89f62-5c, col_values=(('qos', UUID('23ad2646-1df4-46a0-9caa-5c96d0e6ed44')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78d89f62-5c, col_values=(('external_ids', {'iface-id': '78d89f62-5c8d-4037-8cc5-75197a31f61e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:62:5e', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c')
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4309014c-5271-5632-b688-f78fe54cec6d', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:58:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738547bc-e9, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap738547bc-e9, col_values=(('qos', UUID('1b3de137-3722-4574-845f-be1f77d9b38a')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap738547bc-e9, col_values=(('external_ids', {'iface-id': '738547bc-e918-4ad8-9dd2-f200dee5daeb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:58:c1', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9')
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da577ed5-0ee2-5532-b5ec-e8eba4681430', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc01d474-0e, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc01d474-0e, col_values=(('qos', UUID('fa93e26b-2ed4-4825-90ad-12b7bead72d1')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc01d474-0e, col_values=(('external_ids', {'iface-id': 'bc01d474-0eab-48f5-841c-8fce27706c20', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:aa:1a', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e')
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:56:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8958e8a0-4f59-5ff2-a480-5cd133579410', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap56c44b1b-00, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap56c44b1b-00, col_values=(('qos', UUID('eb4da3b2-f22f-42db-8595-e18c2de9d4dd')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap56c44b1b-00, col_values=(('external_ids', {'iface-id': '56c44b1b-00c2-47ce-b2a5-3a01ff177c59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:f5:f2', 'vm-uuid': '4fae7c1c-745c-41b6-a682-c40e6d507b0d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: INFO os_vif [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00')
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] No BDM found with device name hda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] No VIF found with MAC fa:16:3e:5c:a8:2d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] No VIF found with MAC fa:16:3e:e2:58:c1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:58:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Using config drive
Oct 30 13:58:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Creating config drive at /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/disk.config
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8j4rpobm {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8j4rpobm" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:20 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:21 user nova-compute[74319]: WARNING nova.compute.manager [req-d8ceeeb9-c2f0-446a-9699-a75942364f88 req-dc80ee78-a057-4024-bef5-9dfda6ab29c1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 for instance with vm_state building and task_state spawning.
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:21 user nova-compute[74319]: WARNING nova.compute.manager [req-7669d59f-9755-4cb7-896a-af67a43ea729 req-b26bb65e-a5e4-488c-a32d-38561840713c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab for instance with vm_state building and task_state spawning.
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:22 user nova-compute[74319]: WARNING nova.compute.manager [req-fa06eb56-a1ff-40de-b2a2-e071fe5857a9 req-33168b92-cf4b-4124-a96e-e1179aeda50c service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb for instance with vm_state building and task_state spawning.
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8d4f2d66-d277-460b-a364-5a8e6c5d110a req-9d3ee40b-c2e4-4252-a66e-fce6a0ce79a9 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 for instance with vm_state building and task_state spawning.
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:23 user nova-compute[74319]: WARNING nova.compute.manager [req-ca3edfa0-7d55-4b63-9bf1-a516d9985e15 req-3c96b3ed-93ad-4846-9402-01354dfca170 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 for instance with vm_state building and task_state spawning.
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:24 user nova-compute[74319]: WARNING nova.compute.manager [req-c793f3bb-8da7-433a-8cb5-0a03ce8abba1 req-775fd40d-3157-47d3-a1e4-616366130498 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb for instance with vm_state building and task_state spawning.
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:25 user nova-compute[74319]: WARNING nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 for instance with vm_state building and task_state spawning.
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:25 user nova-compute[74319]: WARNING nova.compute.manager [req-f1bb0434-72b3-4d0f-a4dc-04ddac2bc703 req-8b672179-2657-4bd0-8446-2eb5af7d76ac service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 for instance with vm_state building and task_state spawning.
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:58:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance spawned successfully.
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:58:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:25 user nova-compute[74319]: INFO nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Took 12.52 seconds to spawn the instance on the hypervisor.
Oct 30 13:58:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:26 user nova-compute[74319]: INFO nova.compute.manager [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Took 138.14 seconds to build instance.
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d892680-6a05-48a4-83cb-b299e2394120 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 138.243s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdm (vdc) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:58:27 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:58:27 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:58:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7629MB free_disk=25.569156646728516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4a623a60-8c92-4860-92a0-57b606be809a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cf3fa11e-80b3-431c-945a-0ab17f07c5b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:58:28 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c is timed out.
Oct 30 13:58:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Successfully detached device vdb from instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c from the live domain config.
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VpRQCZqi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:28 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c75eba-d546-46d3-ac60-c5c1f330a577]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:28 user nova-compute[74319]: No targets found.
Oct 30 13:58:28 user nova-compute[74319]: iSNS:
Oct 30 13:58:28 user nova-compute[74319]: No targets found.
Oct 30 13:58:28 user nova-compute[74319]: STATIC:
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4
Oct 30 13:58:28 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:28 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:28 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:28 user nova-compute[74319]: No targets found.
Oct 30 13:58:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:28 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:28 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb92c4c-e765-440b-9c8c-9db88d6eb906]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cedddca-9087-406c-a8a1-4a737e5a2a19]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99869a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b690336f-6c0f-46ac-9659-f095c3314676]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af77cfa-d2c4-4c04-bed8-4518edf99190]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cc026f-00dd-47a8-8aab-98aa44bd2ed0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970d1bb-41a6-4e25-967e-20471371e1c3]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01ef6b7-205e-4807-bb61-80c20de5e4d0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[949c9fb2-fcbd-4042-8506-0010b9130bf0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260]
Oct 30 13:58:28 user nova-compute[74319]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8452969-d0a2-4506-a2d9-8b1a71afc389 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e895e73-0853-4d39-a7ce-0eb336caddb6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] <== disconnect_volume: return (407ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:58:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.810s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:58:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 13:58:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating instance_info_cache with network_info: [{"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:58:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-4a623a60-8c92-4860-92a0-57b606be809a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:58:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 13:58:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:58:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG nova.objects.instance [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lazy-loading 'flavor' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-27c69e35-46c2-45dc-b788-a78efae0ece1 tempest-VolumesAssistedSnapshotsTest-1175657920 tempest-VolumesAssistedSnapshotsTest-1175657920-project-admin] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.987s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1', 'serial': '6d473324-4b27-4d5b-a540-eba1228f2ab1'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'serial'} {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:35 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea73719-4bda-44e5-9b49-7cf2fe1af26c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:58:35 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc426505-d622-4721-bd0c-70e51c76885d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1] added
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ffc005-b206-4e65-a4d4-38cac4d218a7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbe2af5-301f-4c76-8184-df7f9a783b7d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TldGeoAU {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TldGeoAU" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edd85e3-4d60-489d-ba8e-ef2d684fe36f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TldGeoAU'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a9155b-e1e1-46e7-8f60-f454c3260781]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.054s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6016615a-8c7c-4897-8bfa-896e1e096688]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --login" returned: 0 in 0.107s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e11dd2-0021-4661-8043-1ddabd1a547a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260]
Oct 30 13:58:35 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 is timed out.
Oct 30 13:58:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully detached device vdb from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the live domain config.
Oct 30 13:58:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JaPbpdOn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6662029-112f-4c01-9cfb-22ccf0fec8e0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d33c10-2fa1-447c-8643-06ec2989a4b3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.490s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7fa972-bb2c-4c0a-af79-0c6afdc6d296]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:36 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 4a623a60-8c92-4860-92a0-57b606be809a is timed out.
Oct 30 13:58:36 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Successfully detached device sdc from instance 4a623a60-8c92-4860-92a0-57b606be809a from the live domain config.
Oct 30 13:58:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GglYFDLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:36 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.556s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== connect_volume: return (1557ms) {'type': 'block', 'scsi_wwn': '26338376339386639', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338376339386639', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.193s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lazy-loading 'flavor' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc99da71-a2f0-4f8d-806a-9686f130da64]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:36 user nova-compute[74319]: No targets found.
Oct 30 13:58:36 user nova-compute[74319]: iSNS:
Oct 30 13:58:36 user nova-compute[74319]: No targets found.
Oct 30 13:58:36 user nova-compute[74319]: STATIC:
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4
Oct 30 13:58:36 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:36 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:36 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:36 user nova-compute[74319]: No targets found.
Oct 30 13:58:36 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:36 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:36 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965d166-cd44-49b5-861b-a5458fdb27cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9d537-65ba-41a8-8ba4-0f077db360ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9987b84c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464'): ({'sdh'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Removing single pathed devices sdh {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7b6dc9-48b2-4a41-a71f-31bb81943da3]: (4, ('path checker states:\nup                  11\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 is timed out.
Oct 30 13:58:37 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully detached device vdb from instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 from the live domain config.
Oct 30 13:58:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NyYtKjPX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:37 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea8a4d-1423-4f1a-9701-66dd124aa71b]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Flushing IO for device /dev/sdh {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3754f8a3-eb36-4d95-acee-3ad7af5ceab4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398545b-520b-4e02-99c9-5f31c35c8888]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e79d45-e098-44d8-8932-055cba84bfd6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[632bd829-9d3a-4e79-b297-59508468eef7]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260]
Oct 30 13:58:37 user nova-compute[74319]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb8d7bf4-00d2-4e1f-b5c6-53c80a895464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aacfff0-3870-406b-a37c-c674f241997d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] <== disconnect_volume: return (1558ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.249s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b46c5-fda2-43ef-a481-88a1fec28cd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]: iSNS:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]: STATIC:
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:37 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:37 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d627d129-7c47-4c41-bad9-fd0152d3d73f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7d5957-fa73-45f9-babe-f72d4c8e8814]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99869b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4'): ({'sdi'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Removing single pathed devices sdi {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1555df9e-3589-4d78-bf66-43c7be949280]: (4, ('path checker states:\nup                  10\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8a1b3-a785-4f4b-942e-76baa7069281]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Flushing IO for device /dev/sdi {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e07a23-6a7b-4067-8c55-957ee09ef5b9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[991158fa-38b1-494a-988e-807df4f210b8]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] SCSI volumes sdi have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ff152-7f8d-40c8-bd4e-5d4f1a6f0e4c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01b2205-5c36-4ba0-a90f-92edc94fbce2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260]
Oct 30 13:58:37 user nova-compute[74319]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a3fe339-609d-4bd8-9e77-a2b811a31fd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe8cf38-e7a0-43cb-b346-044967601a4f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] <== disconnect_volume: return (1687ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.668s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb63e75d-1db1-4c1b-843c-3a0963d49c41]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]: iSNS:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]: STATIC:
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:58:37 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:37 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:37 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:37 user nova-compute[74319]: No targets found.
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:37 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:37 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7170f09-9d30-42a5-be35-b7f135a6acb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[009d6119-168c-4914-9fe3-01f2b39c1ab3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:37 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99863e9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171'): ({'sdj'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Removing single pathed devices sdj {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb7aacb-001e-4259-bdc4-cc28b8f4459f]: (4, ('path checker states:\nup                  9\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[404da8f1-43ba-4bbc-8157-31313a05094e]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Flushing IO for device /dev/sdj {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 156237824 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c66a5-6a69-403f-84b2-25ef24114851]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb21c54-b2f2-4ee6-b040-054f62a559de]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] SCSI volumes sdj have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed081ad9-2754-4d6c-a530-0dae5f4681d3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e8949-d550-4e48-82d8-b9bc40fa014c]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260]
Oct 30 13:58:38 user nova-compute[74319]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad4abce-a5b6-4de9-b6e3-849dc81c8171 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbeb797-c2a0-4862-a1bf-0c61aff8b671]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] <== disconnect_volume: return (1098ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 304087040 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 409993216 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 564133888 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lazy-loading 'flavor' on Instance uuid 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b7e9b3b7-92b0-4ba9-8dd3-d72a24779ce8 tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.417s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 678428672 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.volume.cinder [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Update attachment failed for attachment 66a93f69-b51a-4f09-a3e2-7d656176f61b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Failed to attach 83717a0f-9ece-49b5-af2c-383e9843ce6a at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Traceback (most recent call last):
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     ret_val = method(obj, context, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     self._do_attach(context, instance, volume, volume_api,
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     self._volume_attach(context, volume, connector, instance,
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     connection_info = volume_api.attachment_update(
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     res = method(self, ctx, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     return method.func(obj, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     resp = self._update('/attachments/%s' % id, body)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     return self.request(url, method, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388]     raise exceptions.from_response(resp, body)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b)
Oct 30 13:58:40 user nova-compute[74319]: ERROR nova.compute.manager [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] 
Oct 30 13:58:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 787480576 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.530s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server [None req-823716cd-052a-4f4e-b319-5ea8d7cf8cda tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a5c69ade-a401-4224-97fd-76c9a5f77f7b)
Oct 30 13:58:40 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:58:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c999f619-499a-4fe8-8ada-658fe56931ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.918s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 913309696 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:41 user nova-compute[74319]: INFO nova.compute.manager [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Terminating instance
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'flavor' on Instance uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b3ad2f67-e67d-41ec-ab41-d56d69f7d512 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.980s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 1009778688 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-unplugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] No waiting events found dispatching network-vif-unplugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-326f2474-1ba1-451f-b080-833518e12c6f req-86fcf320-2e9f-48cb-8521-5c7666d1a497 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-unplugged-39585cd9-befe-421d-a47c-67a5f53e096c for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Attempting to detach device tap8cb91cb3-34 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] detach device xml: <interface type="ethernet">
Oct 30 13:58:41 user nova-compute[74319]:   <mac address="fa:16:3e:75:45:9a"/>
Oct 30 13:58:41 user nova-compute[74319]:   <model type="virtio"/>
Oct 30 13:58:41 user nova-compute[74319]:   <mtu size="1442"/>
Oct 30 13:58:41 user nova-compute[74319]:   <target dev="tap8cb91cb3-34"/>
Oct 30 13:58:41 user nova-compute[74319]: </interface>
Oct 30 13:58:41 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 30 13:58:41 user nova-compute[74319]:   <name>instance-00000006</name>
Oct 30 13:58:41 user nova-compute[74319]:   <uuid>279dca02-f5a2-44cb-9c37-3802a64e7901</uuid>
Oct 30 13:58:41 user nova-compute[74319]:   <metadata>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:58:41 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:56:54</nova:creationTime>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:58:41 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:58:41 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:owner>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:58:41 user nova-compute[74319]:   </nova:owner>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:58:41 user nova-compute[74319]:   <nova:ports>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:58:41 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:58:41 user nova-compute[74319]:     </nova:port>
Oct 30 13:58:41 user nova-compute[74319]:     <nova:port uuid="8cb91cb3-34de-48cd-bd26-8c3ce1a840f1">
Oct 30 13:58:41 user nova-compute[74319]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Oct 30 13:58:41 user nova-compute[74319]:     </nova:port>
Oct 30 13:58:41 user nova-compute[74319]:   </nova:ports>
Oct 30 13:58:41 user nova-compute[74319]: </nova:instance>
Oct 30 13:58:41 user nova-compute[74319]:   </metadata>
Oct 30 13:58:41 user nova-compute[74319]:   <memory unit='KiB'>524288</memory>
Oct 30 13:58:41 user nova-compute[74319]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 13:58:41 user nova-compute[74319]:   <vcpu placement='static'>1</vcpu>
Oct 30 13:58:41 user nova-compute[74319]:   <resource>
Oct 30 13:58:41 user nova-compute[74319]:     <partition>/machine</partition>
Oct 30 13:58:41 user nova-compute[74319]:   </resource>
Oct 30 13:58:41 user nova-compute[74319]:   <sysinfo type='smbios'>
Oct 30 13:58:41 user nova-compute[74319]:     <system>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='version'>0.0.0</entry>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='serial'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='uuid'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:58:41 user nova-compute[74319]:       <entry name='family'>Virtual Machine</entry>
Oct 30 13:58:41 user nova-compute[74319]:     </system>
Oct 30 13:58:41 user nova-compute[74319]:   </sysinfo>
Oct 30 13:58:41 user nova-compute[74319]:   <os>
Oct 30 13:58:41 user nova-compute[74319]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 13:58:41 user nova-compute[74319]:     <boot dev='hd'/>
Oct 30 13:58:41 user nova-compute[74319]:     <smbios mode='sysinfo'/>
Oct 30 13:58:41 user nova-compute[74319]:   </os>
Oct 30 13:58:41 user nova-compute[74319]:   <features>
Oct 30 13:58:41 user nova-compute[74319]:     <acpi/>
Oct 30 13:58:41 user nova-compute[74319]:     <apic/>
Oct 30 13:58:41 user nova-compute[74319]:     <vmcoreinfo state='on'/>
Oct 30 13:58:41 user nova-compute[74319]:   </features>
Oct 30 13:58:41 user nova-compute[74319]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 13:58:41 user nova-compute[74319]:     <model fallback='forbid'>Nehalem</model>
Oct 30 13:58:41 user nova-compute[74319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 13:58:41 user nova-compute[74319]:     <feature policy='require' name='vme'/>
Oct 30 13:58:41 user nova-compute[74319]:     <feature policy='require' name='x2apic'/>
Oct 30 13:58:41 user nova-compute[74319]:     <feature policy='require' name='hypervisor'/>
Oct 30 13:58:41 user nova-compute[74319]:   </cpu>
Oct 30 13:58:41 user nova-compute[74319]:   <clock offset='utc'>
Oct 30 13:58:41 user nova-compute[74319]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 13:58:41 user nova-compute[74319]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 13:58:41 user nova-compute[74319]:     <timer name='hpet' present='no'/>
Oct 30 13:58:41 user nova-compute[74319]:   </clock>
Oct 30 13:58:41 user nova-compute[74319]:   <on_poweroff>destroy</on_poweroff>
Oct 30 13:58:41 user nova-compute[74319]:   <on_reboot>restart</on_reboot>
Oct 30 13:58:41 user nova-compute[74319]:   <on_crash>destroy</on_crash>
Oct 30 13:58:41 user nova-compute[74319]:   <devices>
Oct 30 13:58:41 user nova-compute[74319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 13:58:41 user nova-compute[74319]:     <disk type='file' device='disk'>
Oct 30 13:58:41 user nova-compute[74319]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 13:58:41 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk' index='2'/>
Oct 30 13:58:41 user nova-compute[74319]:       <backingStore type='file' index='3'>
Oct 30 13:58:41 user nova-compute[74319]:         <format type='raw'/>
Oct 30 13:58:41 user nova-compute[74319]:         <source file='/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d'/>
Oct 30 13:58:41 user nova-compute[74319]:         <backingStore/>
Oct 30 13:58:41 user nova-compute[74319]:       </backingStore>
Oct 30 13:58:41 user nova-compute[74319]:       <target dev='vda' bus='virtio'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='virtio-disk0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </disk>
Oct 30 13:58:41 user nova-compute[74319]:     <disk type='file' device='cdrom'>
Oct 30 13:58:41 user nova-compute[74319]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 13:58:41 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config' index='1'/>
Oct 30 13:58:41 user nova-compute[74319]:       <backingStore/>
Oct 30 13:58:41 user nova-compute[74319]:       <target dev='hda' bus='ide'/>
Oct 30 13:58:41 user nova-compute[74319]:       <readonly/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='ide0-0-0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </disk>
Oct 30 13:58:41 user nova-compute[74319]:     <controller type='usb' index='0' model='none'>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='usb'/>
Oct 30 13:58:41 user nova-compute[74319]:     </controller>
Oct 30 13:58:41 user nova-compute[74319]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='pci.0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </controller>
Oct 30 13:58:41 user nova-compute[74319]:     <controller type='ide' index='0'>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='ide'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 13:58:41 user nova-compute[74319]:     </controller>
Oct 30 13:58:41 user nova-compute[74319]:     <interface type='ethernet'>
Oct 30 13:58:41 user nova-compute[74319]:       <mac address='fa:16:3e:ea:e3:d4'/>
Oct 30 13:58:41 user nova-compute[74319]:       <target dev='tap007cce73-57'/>
Oct 30 13:58:41 user nova-compute[74319]:       <model type='virtio'/>
Oct 30 13:58:41 user nova-compute[74319]:       <mtu size='1442'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='net0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </interface>
Oct 30 13:58:41 user nova-compute[74319]:     <interface type='ethernet'>
Oct 30 13:58:41 user nova-compute[74319]:       <mac address='fa:16:3e:75:45:9a'/>
Oct 30 13:58:41 user nova-compute[74319]:       <target dev='tap8cb91cb3-34'/>
Oct 30 13:58:41 user nova-compute[74319]:       <model type='virtio'/>
Oct 30 13:58:41 user nova-compute[74319]:       <mtu size='1442'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='net1'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </interface>
Oct 30 13:58:41 user nova-compute[74319]:     <serial type='pty'>
Oct 30 13:58:41 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:58:41 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:58:41 user nova-compute[74319]:       <target type='isa-serial' port='0'>
Oct 30 13:58:41 user nova-compute[74319]:         <model name='isa-serial'/>
Oct 30 13:58:41 user nova-compute[74319]:       </target>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </serial>
Oct 30 13:58:41 user nova-compute[74319]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 13:58:41 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:58:41 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:58:41 user nova-compute[74319]:       <target type='serial' port='0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </console>
Oct 30 13:58:41 user nova-compute[74319]:     <input type='mouse' bus='ps2'>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='input0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </input>
Oct 30 13:58:41 user nova-compute[74319]:     <input type='keyboard' bus='ps2'>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='input1'/>
Oct 30 13:58:41 user nova-compute[74319]:     </input>
Oct 30 13:58:41 user nova-compute[74319]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 30 13:58:41 user nova-compute[74319]:       <listen type='address' address='0.0.0.0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </graphics>
Oct 30 13:58:41 user nova-compute[74319]:     <audio id='1' type='none'/>
Oct 30 13:58:41 user nova-compute[74319]:     <video>
Oct 30 13:58:41 user nova-compute[74319]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='video0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </video>
Oct 30 13:58:41 user nova-compute[74319]:     <memballoon model='virtio'>
Oct 30 13:58:41 user nova-compute[74319]:       <stats period='10'/>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='balloon0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </memballoon>
Oct 30 13:58:41 user nova-compute[74319]:     <rng model='virtio'>
Oct 30 13:58:41 user nova-compute[74319]:       <backend model='random'>/dev/urandom</backend>
Oct 30 13:58:41 user nova-compute[74319]:       <alias name='rng0'/>
Oct 30 13:58:41 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 13:58:41 user nova-compute[74319]:     </rng>
Oct 30 13:58:41 user nova-compute[74319]:   </devices>
Oct 30 13:58:41 user nova-compute[74319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 13:58:41 user nova-compute[74319]:     <label>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</label>
Oct 30 13:58:41 user nova-compute[74319]:     <imagelabel>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</imagelabel>
Oct 30 13:58:41 user nova-compute[74319]:   </seclabel>
Oct 30 13:58:41 user nova-compute[74319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 13:58:41 user nova-compute[74319]:     <label>+64055:+108</label>
Oct 30 13:58:41 user nova-compute[74319]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 13:58:41 user nova-compute[74319]:   </seclabel>
Oct 30 13:58:41 user nova-compute[74319]: </domain>
Oct 30 13:58:41 user nova-compute[74319]:  {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 13:58:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully detached device tap8cb91cb3-34 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the persistent domain config.
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] (1/8): Attempting to detach device tap8cb91cb3-34 with device alias net1 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] detach device xml: <interface type="ethernet">
Oct 30 13:58:41 user nova-compute[74319]:   <mac address="fa:16:3e:75:45:9a"/>
Oct 30 13:58:41 user nova-compute[74319]:   <model type="virtio"/>
Oct 30 13:58:41 user nova-compute[74319]:   <mtu size="1442"/>
Oct 30 13:58:41 user nova-compute[74319]:   <target dev="tap8cb91cb3-34"/>
Oct 30 13:58:41 user nova-compute[74319]: </interface>
Oct 30 13:58:41 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:58:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Instance destroyed successfully.
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lazy-loading 'resources' on Instance uuid 4a623a60-8c92-4860-92a0-57b606be809a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1479074865',display_name='tempest-AttachSCSIVolumeTestJSON-server-1479074865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1479074865',id=3,image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDJoszXKHP6k4TsOB9r9QswAZmNJi7DyOXenwX8SzUkYb5y2BvG1Xh1Z8Qc/+odgq4xYrhrQVSlYDLhV8h5AZErU+6x7fH8LSVwVBX5cl7+sGtMVkHo3e1ZJSTvvKMaew==',key_name='tempest-keypair-731347147',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de628f0340944bfcabf684a26d036d5f',ramdisk_id='',reservation_id='r-8t49tgyr',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a4779bca-25e1-403c-aba1-ab476117ee56',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-919970527',owner_user_name='tempest-AttachSCSIVolumeTestJSON-919970527-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ef82049505dc43df9f616141bddb264d',uuid=4a623a60-8c92-4860-92a0-57b606be809a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converting VIF {"id": "39585cd9-befe-421d-a47c-67a5f53e096c", "address": "fa:16:3e:77:12:ff", "network": {"id": "b1a01771-dd4a-4b59-94f7-67bcfb40d551", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1110457158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de628f0340944bfcabf684a26d036d5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39585cd9-be", "ovs_interfaceid": "39585cd9-befe-421d-a47c-67a5f53e096c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG os_vif [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39585cd9-be, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Start waiting for the detach event from libvirt for device tap8cb91cb3-34 with device alias net1 for instance 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:58:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1e1d4c2-760e-4ff4-9f01-aad9318aa186) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: INFO os_vif [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:12:ff,bridge_name='br-int',has_traffic_filtering=True,id=39585cd9-befe-421d-a47c-67a5f53e096c,network=Network(b1a01771-dd4a-4b59-94f7-67bcfb40d551),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39585cd9-be')
Oct 30 13:58:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Deleting instance files /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a_del
Oct 30 13:58:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Deletion of /opt/stack/data/nova/instances/4a623a60-8c92-4860-92a0-57b606be809a_del complete
Oct 30 13:58:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-unplugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-unplugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:42 user nova-compute[74319]: WARNING nova.compute.manager [req-d57074d9-cd9e-44cc-923c-4de493914e50 req-311aa45a-10bb-41af-82ad-af5a71474908 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-unplugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 for instance with vm_state active and task_state None.
Oct 30 13:58:42 user nova-compute[74319]: INFO nova.compute.manager [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Took 1.10 seconds to destroy the instance on the hypervisor.
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[431cb39d-8fa5-4ed4-a0e9-1c674aba0748]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:58:42 user nova-compute[74319]: No targets found.
Oct 30 13:58:42 user nova-compute[74319]: iSNS:
Oct 30 13:58:42 user nova-compute[74319]: No targets found.
Oct 30 13:58:42 user nova-compute[74319]: STATIC:
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:58:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:58:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:58:42 user nova-compute[74319]: FIRMWARE:
Oct 30 13:58:42 user nova-compute[74319]: No targets found.
Oct 30 13:58:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:58:42 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:58:42 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64ac502-59df-4354-b095-2fa2fda324c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[165023bb-6b6f-440d-af91-aa7928afb95b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:58:42 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:58:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99863fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f71b5c8-35c4-4672-9e83-23cbdd8673fc]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a8e35-35aa-4736-b92b-6f2db11b93a0]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c8f61b-597f-4b68-8dfb-558706f46399]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaa9be9-1ab4-4193-9046-ab44e5a5bbb2]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b744ac2-a679-4917-9d16-9063d23da8e5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[115574b8-d8ee-4a54-8116-9d9ee1aa5f73]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]
Oct 30 13:58:42 user nova-compute[74319]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.
Oct 30 13:58:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e909d9a9-d2e6-4e05-a339-4c3ba15e0637]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== disconnect_volume: return (359ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1', 'serial'} {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 30 13:58:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: removing Cinder connection for volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159 {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:58:43 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Took 1.15 seconds to deallocate network for instance.
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] Acquiring lock "4a623a60-8c92-4860-92a0-57b606be809a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] Lock "4a623a60-8c92-4860-92a0-57b606be809a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] No waiting events found dispatching network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:43 user nova-compute[74319]: WARNING nova.compute.manager [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received unexpected event network-vif-plugged-39585cd9-befe-421d-a47c-67a5f53e096c for instance with vm_state deleted and task_state None.
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-9cb3c62c-3ad6-42b6-9c46-a7b176287ffd req-8da81966-76d4-4333-aa19-ed37857a1bc8 service nova] [instance: 4a623a60-8c92-4860-92a0-57b606be809a] Received event network-vif-deleted-39585cd9-befe-421d-a47c-67a5f53e096c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: Updating volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TldGeoAU", "auth_password": "smZkoSeI4UMyRA", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "6d473324-4b27-4d5b-a540-eba1228f2ab1"}, "status": "reserved", "instance": "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4", "attached_at": "", "detached_at": "", "volume_id": "6d473324-4b27-4d5b-a540-eba1228f2ab1", "serial": "6d473324-4b27-4d5b-a540-eba1228f2ab1"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1', 'no_device': None, 'attachment_id': '2189bda5-13c6-422c-a219-5888a767a6fa'} {{(pid=74319) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8999baaf-1d33-490c-b108-548bc3d273fc tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 36.075s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:43 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Deleted allocations for instance 4a623a60-8c92-4860-92a0-57b606be809a
Oct 30 13:58:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bf22784a-8cd5-4278-b3ba-46b583f013ad tempest-AttachSCSIVolumeTestJSON-919970527 tempest-AttachSCSIVolumeTestJSON-919970527-project-member] Lock "4a623a60-8c92-4860-92a0-57b606be809a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:58:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:58:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:58:44 user nova-compute[74319]: WARNING nova.compute.manager [req-a61826b8-9dfd-4ade-871c-ede06225f29a req-a57b5028-ce91-459f-98cb-350a136c366a service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 for instance with vm_state active and task_state None.
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.utils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8857fab-53ce-48cb-bace-d1b73f069965]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c8ca05-c40c-408a-84c4-0656c66de959]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e1771-5a5f-47e0-83c4-cfc96686b7a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97b2b48-d9a0-4cd3-9bfd-eabc482ff62f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 13:58:45 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 13:58:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e1ee69-a79b-4248-b750-f6c370b24d8a]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 13:58:45 user nova-compute[74319]: DEBUG os_brick.utils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:58:45 user nova-compute[74319]: INFO nova.compute.manager [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Swapping volume 6d473324-4b27-4d5b-a540-eba1228f2ab1 for 7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:58:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:58:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:01 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Waiting for libvirt event about the detach of device tap8cb91cb3-34 with device alias net1 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 is timed out.
Oct 30 13:59:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:59:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 30 13:59:01 user nova-compute[74319]:   <name>instance-00000006</name>
Oct 30 13:59:01 user nova-compute[74319]:   <uuid>279dca02-f5a2-44cb-9c37-3802a64e7901</uuid>
Oct 30 13:59:01 user nova-compute[74319]:   <metadata>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:01 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:56:54</nova:creationTime>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:59:01 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:01 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:owner>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:59:01 user nova-compute[74319]:   </nova:owner>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:01 user nova-compute[74319]:   <nova:ports>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:59:01 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:59:01 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:01 user nova-compute[74319]:     <nova:port uuid="8cb91cb3-34de-48cd-bd26-8c3ce1a840f1">
Oct 30 13:59:01 user nova-compute[74319]:       <nova:ip type="fixed" address="10.10.10.41" ipVersion="4"/>
Oct 30 13:59:01 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:01 user nova-compute[74319]:   </nova:ports>
Oct 30 13:59:01 user nova-compute[74319]: </nova:instance>
Oct 30 13:59:01 user nova-compute[74319]:   </metadata>
Oct 30 13:59:01 user nova-compute[74319]:   <memory unit='KiB'>524288</memory>
Oct 30 13:59:01 user nova-compute[74319]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 13:59:01 user nova-compute[74319]:   <vcpu placement='static'>1</vcpu>
Oct 30 13:59:01 user nova-compute[74319]:   <resource>
Oct 30 13:59:01 user nova-compute[74319]:     <partition>/machine</partition>
Oct 30 13:59:01 user nova-compute[74319]:   </resource>
Oct 30 13:59:01 user nova-compute[74319]:   <sysinfo type='smbios'>
Oct 30 13:59:01 user nova-compute[74319]:     <system>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='version'>0.0.0</entry>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='serial'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='uuid'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:01 user nova-compute[74319]:       <entry name='family'>Virtual Machine</entry>
Oct 30 13:59:01 user nova-compute[74319]:     </system>
Oct 30 13:59:01 user nova-compute[74319]:   </sysinfo>
Oct 30 13:59:01 user nova-compute[74319]:   <os>
Oct 30 13:59:01 user nova-compute[74319]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 13:59:01 user nova-compute[74319]:     <boot dev='hd'/>
Oct 30 13:59:01 user nova-compute[74319]:     <smbios mode='sysinfo'/>
Oct 30 13:59:01 user nova-compute[74319]:   </os>
Oct 30 13:59:01 user nova-compute[74319]:   <features>
Oct 30 13:59:01 user nova-compute[74319]:     <acpi/>
Oct 30 13:59:01 user nova-compute[74319]:     <apic/>
Oct 30 13:59:01 user nova-compute[74319]:     <vmcoreinfo state='on'/>
Oct 30 13:59:01 user nova-compute[74319]:   </features>
Oct 30 13:59:01 user nova-compute[74319]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 13:59:01 user nova-compute[74319]:     <model fallback='forbid'>Nehalem</model>
Oct 30 13:59:01 user nova-compute[74319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 13:59:01 user nova-compute[74319]:     <feature policy='require' name='vme'/>
Oct 30 13:59:01 user nova-compute[74319]:     <feature policy='require' name='x2apic'/>
Oct 30 13:59:01 user nova-compute[74319]:     <feature policy='require' name='hypervisor'/>
Oct 30 13:59:01 user nova-compute[74319]:   </cpu>
Oct 30 13:59:01 user nova-compute[74319]:   <clock offset='utc'>
Oct 30 13:59:01 user nova-compute[74319]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 13:59:01 user nova-compute[74319]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 13:59:01 user nova-compute[74319]:     <timer name='hpet' present='no'/>
Oct 30 13:59:01 user nova-compute[74319]:   </clock>
Oct 30 13:59:01 user nova-compute[74319]:   <on_poweroff>destroy</on_poweroff>
Oct 30 13:59:01 user nova-compute[74319]:   <on_reboot>restart</on_reboot>
Oct 30 13:59:01 user nova-compute[74319]:   <on_crash>destroy</on_crash>
Oct 30 13:59:01 user nova-compute[74319]:   <devices>
Oct 30 13:59:01 user nova-compute[74319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 13:59:01 user nova-compute[74319]:     <disk type='file' device='disk'>
Oct 30 13:59:01 user nova-compute[74319]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 13:59:01 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk' index='2'/>
Oct 30 13:59:01 user nova-compute[74319]:       <backingStore type='file' index='3'>
Oct 30 13:59:01 user nova-compute[74319]:         <format type='raw'/>
Oct 30 13:59:01 user nova-compute[74319]:         <source file='/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d'/>
Oct 30 13:59:01 user nova-compute[74319]:         <backingStore/>
Oct 30 13:59:01 user nova-compute[74319]:       </backingStore>
Oct 30 13:59:01 user nova-compute[74319]:       <target dev='vda' bus='virtio'/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='virtio-disk0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </disk>
Oct 30 13:59:01 user nova-compute[74319]:     <disk type='file' device='cdrom'>
Oct 30 13:59:01 user nova-compute[74319]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 13:59:01 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config' index='1'/>
Oct 30 13:59:01 user nova-compute[74319]:       <backingStore/>
Oct 30 13:59:01 user nova-compute[74319]:       <target dev='hda' bus='ide'/>
Oct 30 13:59:01 user nova-compute[74319]:       <readonly/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='ide0-0-0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </disk>
Oct 30 13:59:01 user nova-compute[74319]:     <controller type='usb' index='0' model='none'>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='usb'/>
Oct 30 13:59:01 user nova-compute[74319]:     </controller>
Oct 30 13:59:01 user nova-compute[74319]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='pci.0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </controller>
Oct 30 13:59:01 user nova-compute[74319]:     <controller type='ide' index='0'>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='ide'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 13:59:01 user nova-compute[74319]:     </controller>
Oct 30 13:59:01 user nova-compute[74319]:     <interface type='ethernet'>
Oct 30 13:59:01 user nova-compute[74319]:       <mac address='fa:16:3e:ea:e3:d4'/>
Oct 30 13:59:01 user nova-compute[74319]:       <target dev='tap007cce73-57'/>
Oct 30 13:59:01 user nova-compute[74319]:       <model type='virtio'/>
Oct 30 13:59:01 user nova-compute[74319]:       <mtu size='1442'/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='net0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </interface>
Oct 30 13:59:01 user nova-compute[74319]:     <serial type='pty'>
Oct 30 13:59:01 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:01 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:01 user nova-compute[74319]:       <target type='isa-serial' port='0'>
Oct 30 13:59:01 user nova-compute[74319]:         <model name='isa-serial'/>
Oct 30 13:59:01 user nova-compute[74319]:       </target>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </serial>
Oct 30 13:59:01 user nova-compute[74319]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 13:59:01 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:01 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:01 user nova-compute[74319]:       <target type='serial' port='0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </console>
Oct 30 13:59:01 user nova-compute[74319]:     <input type='mouse' bus='ps2'>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='input0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </input>
Oct 30 13:59:01 user nova-compute[74319]:     <input type='keyboard' bus='ps2'>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='input1'/>
Oct 30 13:59:01 user nova-compute[74319]:     </input>
Oct 30 13:59:01 user nova-compute[74319]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 30 13:59:01 user nova-compute[74319]:       <listen type='address' address='0.0.0.0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </graphics>
Oct 30 13:59:01 user nova-compute[74319]:     <audio id='1' type='none'/>
Oct 30 13:59:01 user nova-compute[74319]:     <video>
Oct 30 13:59:01 user nova-compute[74319]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='video0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </video>
Oct 30 13:59:01 user nova-compute[74319]:     <memballoon model='virtio'>
Oct 30 13:59:01 user nova-compute[74319]:       <stats period='10'/>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='balloon0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </memballoon>
Oct 30 13:59:01 user nova-compute[74319]:     <rng model='virtio'>
Oct 30 13:59:01 user nova-compute[74319]:       <backend model='random'>/dev/urandom</backend>
Oct 30 13:59:01 user nova-compute[74319]:       <alias name='rng0'/>
Oct 30 13:59:01 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 13:59:01 user nova-compute[74319]:     </rng>
Oct 30 13:59:01 user nova-compute[74319]:   </devices>
Oct 30 13:59:01 user nova-compute[74319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 13:59:01 user nova-compute[74319]:     <label>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</label>
Oct 30 13:59:01 user nova-compute[74319]:     <imagelabel>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</imagelabel>
Oct 30 13:59:01 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:01 user nova-compute[74319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 13:59:01 user nova-compute[74319]:     <label>+64055:+108</label>
Oct 30 13:59:01 user nova-compute[74319]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 13:59:01 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:01 user nova-compute[74319]: </domain>
Oct 30 13:59:01 user nova-compute[74319]:  {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 13:59:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully detached device tap8cb91cb3-34 from instance 279dca02-f5a2-44cb-9c37-3802a64e7901 from the live domain config.
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG os_vif [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb91cb3-34, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=354e24c7-6b02-4e20-895f-74de731fe372) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: INFO os_vif [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34')
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:02 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:59:02</nova:creationTime>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:59:02 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:ports>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:59:02 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:59:02 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:ports>
Oct 30 13:59:02 user nova-compute[74319]: </nova:instance>
Oct 30 13:59:02 user nova-compute[74319]:  {{(pid=74319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-deleted-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:02 user nova-compute[74319]: INFO nova.compute.manager [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Neutron deleted interface 8cb91cb3-34de-48cd-bd26-8c3ce1a840f1; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.neutron [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.objects.instance [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Lazy-loading 'system_metadata' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquired lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.objects.instance [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Lazy-loading 'flavor' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.objects.base [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Object Instance<279dca02-f5a2-44cb-9c37-3802a64e7901> lazy-loaded attributes: system_metadata,flavor {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 30 13:59:02 user nova-compute[74319]:   <name>instance-00000006</name>
Oct 30 13:59:02 user nova-compute[74319]:   <uuid>279dca02-f5a2-44cb-9c37-3802a64e7901</uuid>
Oct 30 13:59:02 user nova-compute[74319]:   <metadata>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:02 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:59:02</nova:creationTime>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:59:02 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:ports>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:59:02 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:59:02 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:ports>
Oct 30 13:59:02 user nova-compute[74319]: </nova:instance>
Oct 30 13:59:02 user nova-compute[74319]:   </metadata>
Oct 30 13:59:02 user nova-compute[74319]:   <memory unit='KiB'>524288</memory>
Oct 30 13:59:02 user nova-compute[74319]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 13:59:02 user nova-compute[74319]:   <vcpu placement='static'>1</vcpu>
Oct 30 13:59:02 user nova-compute[74319]:   <resource>
Oct 30 13:59:02 user nova-compute[74319]:     <partition>/machine</partition>
Oct 30 13:59:02 user nova-compute[74319]:   </resource>
Oct 30 13:59:02 user nova-compute[74319]:   <sysinfo type='smbios'>
Oct 30 13:59:02 user nova-compute[74319]:     <system>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='version'>0.0.0</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='serial'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='uuid'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='family'>Virtual Machine</entry>
Oct 30 13:59:02 user nova-compute[74319]:     </system>
Oct 30 13:59:02 user nova-compute[74319]:   </sysinfo>
Oct 30 13:59:02 user nova-compute[74319]:   <os>
Oct 30 13:59:02 user nova-compute[74319]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 13:59:02 user nova-compute[74319]:     <boot dev='hd'/>
Oct 30 13:59:02 user nova-compute[74319]:     <smbios mode='sysinfo'/>
Oct 30 13:59:02 user nova-compute[74319]:   </os>
Oct 30 13:59:02 user nova-compute[74319]:   <features>
Oct 30 13:59:02 user nova-compute[74319]:     <acpi/>
Oct 30 13:59:02 user nova-compute[74319]:     <apic/>
Oct 30 13:59:02 user nova-compute[74319]:     <vmcoreinfo state='on'/>
Oct 30 13:59:02 user nova-compute[74319]:   </features>
Oct 30 13:59:02 user nova-compute[74319]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 13:59:02 user nova-compute[74319]:     <model fallback='forbid'>Nehalem</model>
Oct 30 13:59:02 user nova-compute[74319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='vme'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='x2apic'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='hypervisor'/>
Oct 30 13:59:02 user nova-compute[74319]:   </cpu>
Oct 30 13:59:02 user nova-compute[74319]:   <clock offset='utc'>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='hpet' present='no'/>
Oct 30 13:59:02 user nova-compute[74319]:   </clock>
Oct 30 13:59:02 user nova-compute[74319]:   <on_poweroff>destroy</on_poweroff>
Oct 30 13:59:02 user nova-compute[74319]:   <on_reboot>restart</on_reboot>
Oct 30 13:59:02 user nova-compute[74319]:   <on_crash>destroy</on_crash>
Oct 30 13:59:02 user nova-compute[74319]:   <devices>
Oct 30 13:59:02 user nova-compute[74319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 13:59:02 user nova-compute[74319]:     <disk type='file' device='disk'>
Oct 30 13:59:02 user nova-compute[74319]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 13:59:02 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk' index='2'/>
Oct 30 13:59:02 user nova-compute[74319]:       <backingStore type='file' index='3'>
Oct 30 13:59:02 user nova-compute[74319]:         <format type='raw'/>
Oct 30 13:59:02 user nova-compute[74319]:         <source file='/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d'/>
Oct 30 13:59:02 user nova-compute[74319]:         <backingStore/>
Oct 30 13:59:02 user nova-compute[74319]:       </backingStore>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='vda' bus='virtio'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='virtio-disk0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </disk>
Oct 30 13:59:02 user nova-compute[74319]:     <disk type='file' device='cdrom'>
Oct 30 13:59:02 user nova-compute[74319]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 13:59:02 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config' index='1'/>
Oct 30 13:59:02 user nova-compute[74319]:       <backingStore/>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='hda' bus='ide'/>
Oct 30 13:59:02 user nova-compute[74319]:       <readonly/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='ide0-0-0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </disk>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='usb' index='0' model='none'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='usb'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='pci.0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='ide' index='0'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='ide'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <interface type='ethernet'>
Oct 30 13:59:02 user nova-compute[74319]:       <mac address='fa:16:3e:ea:e3:d4'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='tap007cce73-57'/>
Oct 30 13:59:02 user nova-compute[74319]:       <model type='virtio'/>
Oct 30 13:59:02 user nova-compute[74319]:       <mtu size='1442'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='net0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </interface>
Oct 30 13:59:02 user nova-compute[74319]:     <serial type='pty'>
Oct 30 13:59:02 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:02 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target type='isa-serial' port='0'>
Oct 30 13:59:02 user nova-compute[74319]:         <model name='isa-serial'/>
Oct 30 13:59:02 user nova-compute[74319]:       </target>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </serial>
Oct 30 13:59:02 user nova-compute[74319]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 13:59:02 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:02 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target type='serial' port='0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </console>
Oct 30 13:59:02 user nova-compute[74319]:     <input type='mouse' bus='ps2'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='input0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </input>
Oct 30 13:59:02 user nova-compute[74319]:     <input type='keyboard' bus='ps2'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='input1'/>
Oct 30 13:59:02 user nova-compute[74319]:     </input>
Oct 30 13:59:02 user nova-compute[74319]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 30 13:59:02 user nova-compute[74319]:       <listen type='address' address='0.0.0.0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </graphics>
Oct 30 13:59:02 user nova-compute[74319]:     <audio id='1' type='none'/>
Oct 30 13:59:02 user nova-compute[74319]:     <video>
Oct 30 13:59:02 user nova-compute[74319]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='video0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </video>
Oct 30 13:59:02 user nova-compute[74319]:     <memballoon model='virtio'>
Oct 30 13:59:02 user nova-compute[74319]:       <stats period='10'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='balloon0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </memballoon>
Oct 30 13:59:02 user nova-compute[74319]:     <rng model='virtio'>
Oct 30 13:59:02 user nova-compute[74319]:       <backend model='random'>/dev/urandom</backend>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='rng0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </rng>
Oct 30 13:59:02 user nova-compute[74319]:   </devices>
Oct 30 13:59:02 user nova-compute[74319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 13:59:02 user nova-compute[74319]:     <label>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</label>
Oct 30 13:59:02 user nova-compute[74319]:     <imagelabel>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</imagelabel>
Oct 30 13:59:02 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:02 user nova-compute[74319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 13:59:02 user nova-compute[74319]:     <label>+64055:+108</label>
Oct 30 13:59:02 user nova-compute[74319]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 13:59:02 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:02 user nova-compute[74319]: </domain>
Oct 30 13:59:02 user nova-compute[74319]:  {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface> {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:75:45:9a"/><model type="virtio"/><mtu size="1442"/><target dev="tap8cb91cb3-34"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 30 13:59:02 user nova-compute[74319]:   <name>instance-00000006</name>
Oct 30 13:59:02 user nova-compute[74319]:   <uuid>279dca02-f5a2-44cb-9c37-3802a64e7901</uuid>
Oct 30 13:59:02 user nova-compute[74319]:   <metadata>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:02 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:59:02</nova:creationTime>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:59:02 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:ports>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:59:02 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:59:02 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:ports>
Oct 30 13:59:02 user nova-compute[74319]: </nova:instance>
Oct 30 13:59:02 user nova-compute[74319]:   </metadata>
Oct 30 13:59:02 user nova-compute[74319]:   <memory unit='KiB'>524288</memory>
Oct 30 13:59:02 user nova-compute[74319]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 30 13:59:02 user nova-compute[74319]:   <vcpu placement='static'>1</vcpu>
Oct 30 13:59:02 user nova-compute[74319]:   <resource>
Oct 30 13:59:02 user nova-compute[74319]:     <partition>/machine</partition>
Oct 30 13:59:02 user nova-compute[74319]:   </resource>
Oct 30 13:59:02 user nova-compute[74319]:   <sysinfo type='smbios'>
Oct 30 13:59:02 user nova-compute[74319]:     <system>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='product'>OpenStack Nova</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='version'>0.0.0</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='serial'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='uuid'>279dca02-f5a2-44cb-9c37-3802a64e7901</entry>
Oct 30 13:59:02 user nova-compute[74319]:       <entry name='family'>Virtual Machine</entry>
Oct 30 13:59:02 user nova-compute[74319]:     </system>
Oct 30 13:59:02 user nova-compute[74319]:   </sysinfo>
Oct 30 13:59:02 user nova-compute[74319]:   <os>
Oct 30 13:59:02 user nova-compute[74319]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 30 13:59:02 user nova-compute[74319]:     <boot dev='hd'/>
Oct 30 13:59:02 user nova-compute[74319]:     <smbios mode='sysinfo'/>
Oct 30 13:59:02 user nova-compute[74319]:   </os>
Oct 30 13:59:02 user nova-compute[74319]:   <features>
Oct 30 13:59:02 user nova-compute[74319]:     <acpi/>
Oct 30 13:59:02 user nova-compute[74319]:     <apic/>
Oct 30 13:59:02 user nova-compute[74319]:     <vmcoreinfo state='on'/>
Oct 30 13:59:02 user nova-compute[74319]:   </features>
Oct 30 13:59:02 user nova-compute[74319]:   <cpu mode='custom' match='exact' check='full'>
Oct 30 13:59:02 user nova-compute[74319]:     <model fallback='forbid'>Nehalem</model>
Oct 30 13:59:02 user nova-compute[74319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='vme'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='x2apic'/>
Oct 30 13:59:02 user nova-compute[74319]:     <feature policy='require' name='hypervisor'/>
Oct 30 13:59:02 user nova-compute[74319]:   </cpu>
Oct 30 13:59:02 user nova-compute[74319]:   <clock offset='utc'>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='pit' tickpolicy='delay'/>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 30 13:59:02 user nova-compute[74319]:     <timer name='hpet' present='no'/>
Oct 30 13:59:02 user nova-compute[74319]:   </clock>
Oct 30 13:59:02 user nova-compute[74319]:   <on_poweroff>destroy</on_poweroff>
Oct 30 13:59:02 user nova-compute[74319]:   <on_reboot>restart</on_reboot>
Oct 30 13:59:02 user nova-compute[74319]:   <on_crash>destroy</on_crash>
Oct 30 13:59:02 user nova-compute[74319]:   <devices>
Oct 30 13:59:02 user nova-compute[74319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 30 13:59:02 user nova-compute[74319]:     <disk type='file' device='disk'>
Oct 30 13:59:02 user nova-compute[74319]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 30 13:59:02 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk' index='2'/>
Oct 30 13:59:02 user nova-compute[74319]:       <backingStore type='file' index='3'>
Oct 30 13:59:02 user nova-compute[74319]:         <format type='raw'/>
Oct 30 13:59:02 user nova-compute[74319]:         <source file='/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d'/>
Oct 30 13:59:02 user nova-compute[74319]:         <backingStore/>
Oct 30 13:59:02 user nova-compute[74319]:       </backingStore>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='vda' bus='virtio'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='virtio-disk0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </disk>
Oct 30 13:59:02 user nova-compute[74319]:     <disk type='file' device='cdrom'>
Oct 30 13:59:02 user nova-compute[74319]:       <driver name='qemu' type='raw' cache='none'/>
Oct 30 13:59:02 user nova-compute[74319]:       <source file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk.config' index='1'/>
Oct 30 13:59:02 user nova-compute[74319]:       <backingStore/>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='hda' bus='ide'/>
Oct 30 13:59:02 user nova-compute[74319]:       <readonly/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='ide0-0-0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </disk>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='usb' index='0' model='none'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='usb'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='pci' index='0' model='pci-root'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='pci.0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <controller type='ide' index='0'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='ide'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 30 13:59:02 user nova-compute[74319]:     </controller>
Oct 30 13:59:02 user nova-compute[74319]:     <interface type='ethernet'>
Oct 30 13:59:02 user nova-compute[74319]:       <mac address='fa:16:3e:ea:e3:d4'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target dev='tap007cce73-57'/>
Oct 30 13:59:02 user nova-compute[74319]:       <model type='virtio'/>
Oct 30 13:59:02 user nova-compute[74319]:       <mtu size='1442'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='net0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </interface>
Oct 30 13:59:02 user nova-compute[74319]:     <serial type='pty'>
Oct 30 13:59:02 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:02 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target type='isa-serial' port='0'>
Oct 30 13:59:02 user nova-compute[74319]:         <model name='isa-serial'/>
Oct 30 13:59:02 user nova-compute[74319]:       </target>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </serial>
Oct 30 13:59:02 user nova-compute[74319]:     <console type='pty' tty='/dev/pts/5'>
Oct 30 13:59:02 user nova-compute[74319]:       <source path='/dev/pts/5'/>
Oct 30 13:59:02 user nova-compute[74319]:       <log file='/opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/console.log' append='off'/>
Oct 30 13:59:02 user nova-compute[74319]:       <target type='serial' port='0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='serial0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </console>
Oct 30 13:59:02 user nova-compute[74319]:     <input type='mouse' bus='ps2'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='input0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </input>
Oct 30 13:59:02 user nova-compute[74319]:     <input type='keyboard' bus='ps2'>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='input1'/>
Oct 30 13:59:02 user nova-compute[74319]:     </input>
Oct 30 13:59:02 user nova-compute[74319]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 30 13:59:02 user nova-compute[74319]:       <listen type='address' address='0.0.0.0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </graphics>
Oct 30 13:59:02 user nova-compute[74319]:     <audio id='1' type='none'/>
Oct 30 13:59:02 user nova-compute[74319]:     <video>
Oct 30 13:59:02 user nova-compute[74319]:       <model type='virtio' heads='1' primary='yes'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='video0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </video>
Oct 30 13:59:02 user nova-compute[74319]:     <memballoon model='virtio'>
Oct 30 13:59:02 user nova-compute[74319]:       <stats period='10'/>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='balloon0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </memballoon>
Oct 30 13:59:02 user nova-compute[74319]:     <rng model='virtio'>
Oct 30 13:59:02 user nova-compute[74319]:       <backend model='random'>/dev/urandom</backend>
Oct 30 13:59:02 user nova-compute[74319]:       <alias name='rng0'/>
Oct 30 13:59:02 user nova-compute[74319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 30 13:59:02 user nova-compute[74319]:     </rng>
Oct 30 13:59:02 user nova-compute[74319]:   </devices>
Oct 30 13:59:02 user nova-compute[74319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 30 13:59:02 user nova-compute[74319]:     <label>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</label>
Oct 30 13:59:02 user nova-compute[74319]:     <imagelabel>libvirt-279dca02-f5a2-44cb-9c37-3802a64e7901</imagelabel>
Oct 30 13:59:02 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:02 user nova-compute[74319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 30 13:59:02 user nova-compute[74319]:     <label>+64055:+108</label>
Oct 30 13:59:02 user nova-compute[74319]:     <imagelabel>+64055:+108</imagelabel>
Oct 30 13:59:02 user nova-compute[74319]:   </seclabel>
Oct 30 13:59:02 user nova-compute[74319]: </domain>
Oct 30 13:59:02 user nova-compute[74319]:  {{(pid=74319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 30 13:59:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Detaching interface fa:16:3e:75:45:9a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8cb91cb3-34' not found.
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Converting VIF {"id": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "address": "fa:16:3e:75:45:9a", "network": {"id": "5badb3eb-af43-4012-af40-fe5f2ee87b75", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-103395055", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cb91cb3-34", "ovs_interfaceid": "8cb91cb3-34de-48cd-bd26-8c3ce1a840f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.network.os_vif_util [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG os_vif [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cb91cb3-34, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:59:02 user nova-compute[74319]: INFO os_vif [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:45:9a,bridge_name='br-int',has_traffic_filtering=True,id=8cb91cb3-34de-48cd-bd26-8c3ce1a840f1,network=Network(5badb3eb-af43-4012-af40-fe5f2ee87b75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cb91cb3-34')
Oct 30 13:59:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [req-f434eded-16a9-433a-aa7e-6b8a161d0667 req-7db433ac-1268-42ba-98ec-89537fb817d4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:02 user nova-compute[74319]:   <nova:package version="0.0.0"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:name>tempest-device-tagging-server-2035355336</nova:name>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:creationTime>2023-10-30 13:59:02</nova:creationTime>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:flavor name="m1.tiny">
Oct 30 13:59:02 user nova-compute[74319]:     <nova:memory>512</nova:memory>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:disk>1</nova:disk>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:swap>0</nova:swap>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:flavor>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:user uuid="be414360ec564f668e2b0704981a231c">tempest-TaggedAttachmentsTest-926275015-project-member</nova:user>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:project uuid="6e9adc75880c451b9ec528bcb47ca8dc">tempest-TaggedAttachmentsTest-926275015</nova:project>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:owner>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:02 user nova-compute[74319]:   <nova:ports>
Oct 30 13:59:02 user nova-compute[74319]:     <nova:port uuid="007cce73-5719-4d78-a8ee-eb979da7f5a6">
Oct 30 13:59:02 user nova-compute[74319]:       <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 13:59:02 user nova-compute[74319]:     </nova:port>
Oct 30 13:59:02 user nova-compute[74319]:   </nova:ports>
Oct 30 13:59:02 user nova-compute[74319]: </nova:instance>
Oct 30 13:59:02 user nova-compute[74319]:  {{(pid=74319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 30 13:59:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [{"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Releasing lock "refresh_cache-279dca02-f5a2-44cb-9c37-3802a64e7901" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38bc3c47-dcca-4f37-949e-38e9c3df32ec tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "interface-279dca02-f5a2-44cb-9c37-3802a64e7901-8cb91cb3-34de-48cd-bd26-8c3ce1a840f1" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.600s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'serial': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1'}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1', 'serial'} {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:08 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:08 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:08 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1946c3-d97d-41f3-b22d-c0677ac56e88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 13:59:08 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8186c5-7237-4074-9555-7328cc4a4970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159] added
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 13:59:08 user nova-compute[74319]: INFO nova.compute.claims [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Claim successful on node user
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[16304007-b306-4389-9a36-05699e7bd33b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1f207-c8c3-481b-8139-d26e85ad7dcb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxCNpYmg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxCNpYmg" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[85765820-e023-4ae0-9839-4810746032bd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxCNpYmg'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cbf11d-5d7b-40e8-938c-6b956b8f70b0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9587441-36d3-494c-8346-c9fb24973898]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[12db6641-076a-4e7a-a803-c8b2b8953352]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]
Oct 30 13:59:08 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdee16a4-83d7-4f63-b4ef-1cc4e36557a8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc975aa1-1508-4249-98cb-741d0cf06845]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:08 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:08 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] HCTL ('39', '-', '-', 0) found on session 17 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b3cc3-603d-4cd4-92d4-3e39f16ee517]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Searching for a device in session 17 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.777s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 13:59:09 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.policy [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6515419e258d4c978180f0a2fec90ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1966fa806de14afa86ce28be485ef471', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 13:59:09 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Creating image(s)
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "/opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "/opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "/opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.434s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26266613734666134', 'path': '/dev/sdh'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266613734666134', 'path': '/dev/sdh'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.objects.instance [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lazy-loading 'flavor' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.215s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Successfully created port: b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk 1073741824" returned: 0 in 0.068s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:09 user nova-compute[74319]: INFO nova.compute.manager [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Terminating instance
Oct 30 13:59:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.207s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Cannot resize image /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Ensure instance console log exists: /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-unplugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] No waiting events found dispatching network-vif-unplugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d9712b5-33c6-45c6-b46c-9ca684949863 req-08f7db32-dc5b-40c4-bbe5-6d4c2bafde43 service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-unplugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Instance destroyed successfully.
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lazy-loading 'resources' on Instance uuid 7ab1d632-5872-4c23-ba05-7a53e2b2a10c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-887241984',display_name='tempest-VolumesAssistedSnapshotsTest-server-887241984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-887241984',id=7,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBILiUGhfUJA0L93RpUjBq8QOpqFpXuY0AHB0g/JPF3zhtJvmtE0XG3rTsOjpl3mJlbyeWqzEhzUQy9+7XXleLXpmU2FUdwDurU97FSu61SM/W6clmErpM6NFtBsHNlvNJA==',key_name='tempest-keypair-1259822635',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='57c8b19c853e4f7c9f004133687b7638',ramdisk_id='',reservation_id='r-hc59vf3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1722884665',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1722884665-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='17e2ebdb640849858c5d396beac1d882',uuid=7ab1d632-5872-4c23-ba05-7a53e2b2a10c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converting VIF {"id": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "address": "fa:16:3e:0b:f0:6e", "network": {"id": "0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1271571639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "57c8b19c853e4f7c9f004133687b7638", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cac5ad3-22", "ovs_interfaceid": "4cac5ad3-229f-47ca-ae69-a46ca5e95daa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG os_vif [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Successfully updated port: b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cac5ad3-22, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f493979e-1cb2-4a94-aaf4-5c7b82b878bb) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquired lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-changed-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Refreshing instance network info cache due to event network-changed-b02a63c2-2cab-459c-8dbf-63bcb9337415. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] Acquiring lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:10 user nova-compute[74319]: INFO os_vif [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:f0:6e,bridge_name='br-int',has_traffic_filtering=True,id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa,network=Network(0d221d7b-cb5d-4948-8ef9-2bb5f7ae8f5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cac5ad3-22')
Oct 30 13:59:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Deleting instance files /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c_del
Oct 30 13:59:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Deletion of /opt/stack/data/nova/instances/7ab1d632-5872-4c23-ba05-7a53e2b2a10c_del complete
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 13:59:11 user nova-compute[74319]: INFO nova.compute.manager [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Took 1.12 seconds to destroy the instance on the hypervisor.
Oct 30 13:59:11 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 87031808 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 162529280 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Updating instance_info_cache with network_info: [{"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Releasing lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Instance network_info: |[{"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] Acquired lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.neutron [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Refreshing network info cache for port b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Start _get_guest_xml network_info=[{"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 13:59:11 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:59:11 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-10879322',display_name='tempest-VolumesAdminNegativeTest-server-10879322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-10879322',id=12,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-4o7ppz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:59:09Z,user_data=None,user_id='6515419e258d4c978180f0a2fec90ecc',uuid=522d8b87-0d8c-42b5-9dfd-d64b8754d64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'pci_devices' on Instance uuid 522d8b87-0d8c-42b5-9dfd-d64b8754d64d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 13:59:11 user nova-compute[74319]:   <uuid>522d8b87-0d8c-42b5-9dfd-d64b8754d64d</uuid>
Oct 30 13:59:11 user nova-compute[74319]:   <name>instance-0000000c</name>
Oct 30 13:59:11 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 13:59:11 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 13:59:11 user nova-compute[74319]:   <metadata>
Oct 30 13:59:11 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 13:59:11 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:name>tempest-VolumesAdminNegativeTest-server-10879322</nova:name>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:creationTime>2023-10-30 13:59:11</nova:creationTime>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 13:59:11 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 13:59:11 user nova-compute[74319]:       </nova:flavor>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:owner>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:user uuid="6515419e258d4c978180f0a2fec90ecc">tempest-VolumesAdminNegativeTest-487685260-project-member</nova:user>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:project uuid="1966fa806de14afa86ce28be485ef471">tempest-VolumesAdminNegativeTest-487685260</nova:project>
Oct 30 13:59:11 user nova-compute[74319]:       </nova:owner>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 13:59:11 user nova-compute[74319]:       <nova:ports>
Oct 30 13:59:11 user nova-compute[74319]:         <nova:port uuid="b02a63c2-2cab-459c-8dbf-63bcb9337415">
Oct 30 13:59:11 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 13:59:11 user nova-compute[74319]:         </nova:port>
Oct 30 13:59:11 user nova-compute[74319]:       </nova:ports>
Oct 30 13:59:11 user nova-compute[74319]:     </nova:instance>
Oct 30 13:59:11 user nova-compute[74319]:   </metadata>
Oct 30 13:59:11 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 13:59:11 user nova-compute[74319]:     <system>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="serial">522d8b87-0d8c-42b5-9dfd-d64b8754d64d</entry>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="uuid">522d8b87-0d8c-42b5-9dfd-d64b8754d64d</entry>
Oct 30 13:59:11 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 13:59:11 user nova-compute[74319]:     </system>
Oct 30 13:59:11 user nova-compute[74319]:   </sysinfo>
Oct 30 13:59:11 user nova-compute[74319]:   <os>
Oct 30 13:59:11 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 13:59:11 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 13:59:11 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 13:59:11 user nova-compute[74319]:   </os>
Oct 30 13:59:11 user nova-compute[74319]:   <features>
Oct 30 13:59:11 user nova-compute[74319]:     <acpi/>
Oct 30 13:59:11 user nova-compute[74319]:     <apic/>
Oct 30 13:59:11 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 13:59:11 user nova-compute[74319]:   </features>
Oct 30 13:59:11 user nova-compute[74319]:   <clock offset="utc">
Oct 30 13:59:11 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 13:59:11 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 13:59:11 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 13:59:11 user nova-compute[74319]:   </clock>
Oct 30 13:59:11 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 13:59:11 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 13:59:11 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 13:59:11 user nova-compute[74319]:   </cpu>
Oct 30 13:59:11 user nova-compute[74319]:   <devices>
Oct 30 13:59:11 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 13:59:11 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 13:59:11 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk"/>
Oct 30 13:59:11 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 13:59:11 user nova-compute[74319]:     </disk>
Oct 30 13:59:11 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 13:59:11 user nova-compute[74319]:       <mac address="fa:16:3e:6d:79:8b"/>
Oct 30 13:59:11 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:59:11 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 13:59:11 user nova-compute[74319]:       <target dev="tapb02a63c2-2c"/>
Oct 30 13:59:11 user nova-compute[74319]:     </interface>
Oct 30 13:59:11 user nova-compute[74319]:     <serial type="pty">
Oct 30 13:59:11 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/console.log" append="off"/>
Oct 30 13:59:11 user nova-compute[74319]:     </serial>
Oct 30 13:59:11 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 13:59:11 user nova-compute[74319]:     <video>
Oct 30 13:59:11 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 13:59:11 user nova-compute[74319]:     </video>
Oct 30 13:59:11 user nova-compute[74319]:     <rng model="virtio">
Oct 30 13:59:11 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 13:59:11 user nova-compute[74319]:     </rng>
Oct 30 13:59:11 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 13:59:11 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 13:59:11 user nova-compute[74319]:       <stats period="10"/>
Oct 30 13:59:11 user nova-compute[74319]:     </memballoon>
Oct 30 13:59:11 user nova-compute[74319]:   </devices>
Oct 30 13:59:11 user nova-compute[74319]: </domain>
Oct 30 13:59:11 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-10879322',display_name='tempest-VolumesAdminNegativeTest-server-10879322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-10879322',id=12,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-4o7ppz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T13:59:09Z,user_data=None,user_id='6515419e258d4c978180f0a2fec90ecc',uuid=522d8b87-0d8c-42b5-9dfd-d64b8754d64d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG os_vif [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3446f40-7abb-5780-a1e9-4545d7422eb8', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb02a63c2-2c, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb02a63c2-2c, col_values=(('qos', UUID('be09d810-f7b6-4f0c-94fa-71fc015f2a1e')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb02a63c2-2c, col_values=(('external_ids', {'iface-id': 'b02a63c2-2cab-459c-8dbf-63bcb9337415', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:79:8b', 'vm-uuid': '522d8b87-0d8c-42b5-9dfd-d64b8754d64d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:11 user nova-compute[74319]: INFO os_vif [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c')
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] No VIF found with MAC fa:16:3e:6d:79:8b, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 218103808 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] Acquiring lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] No waiting events found dispatching network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:12 user nova-compute[74319]: WARNING nova.compute.manager [req-ea19ba31-35e2-4cfd-81dc-5ab4dbc2fee1 req-e7467bee-373d-45cf-89ad-2d7310dbafeb service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received unexpected event network-vif-plugged-4cac5ad3-229f-47ca-ae69-a46ca5e95daa for instance with vm_state active and task_state deleting.
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 341835776 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.network.neutron [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Updated VIF entry in instance network info cache for port b02a63c2-2cab-459c-8dbf-63bcb9337415. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG nova.network.neutron [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Updating instance_info_cache with network_info: [{"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c032a2af-b91e-4adf-a4e5-293113088f4f req-bd95deca-804a-483f-9c79-74ffb3a3021d service nova] Releasing lock "refresh_cache-522d8b87-0d8c-42b5-9dfd-d64b8754d64d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-52c207fd-9bd7-405e-865b-df318d01b083 req-e9152999-6ff8-4a3c-8832-c7c4fcd868ce service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Received event network-vif-deleted-4cac5ad3-229f-47ca-ae69-a46ca5e95daa {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:13 user nova-compute[74319]: INFO nova.compute.manager [req-52c207fd-9bd7-405e-865b-df318d01b083 req-e9152999-6ff8-4a3c-8832-c7c4fcd868ce service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Neutron deleted interface 4cac5ad3-229f-47ca-ae69-a46ca5e95daa; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.network.neutron [req-52c207fd-9bd7-405e-865b-df318d01b083 req-e9152999-6ff8-4a3c-8832-c7c4fcd868ce service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:13 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Took 2.19 seconds to deallocate network for instance.
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 485490688 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-52c207fd-9bd7-405e-865b-df318d01b083 req-e9152999-6ff8-4a3c-8832-c7c4fcd868ce service nova] [instance: 7ab1d632-5872-4c23-ba05-7a53e2b2a10c] Detach interface failed, port_id=4cac5ad3-229f-47ca-ae69-a46ca5e95daa, reason: Instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 583008256 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.711s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:14 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Deleted allocations for instance 7ab1d632-5872-4c23-ba05-7a53e2b2a10c
Oct 30 13:59:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 691011584 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b440d90a-76d6-4799-89fc-2f9dad35d18d tempest-VolumesAssistedSnapshotsTest-1722884665 tempest-VolumesAssistedSnapshotsTest-1722884665-project-member] Lock "7ab1d632-5872-4c23-ba05-7a53e2b2a10c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.549s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 753926144 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:14 user nova-compute[74319]: WARNING nova.compute.manager [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Timeout waiting for ['volume-reimaged-05e121ec-970e-4e6a-8701-36f0febdac05'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-05e121ec-970e-4e6a-8701-36f0febdac05: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Oct 30 13:59:14 user nova-compute[74319]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7fe9986b1fc0 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Oct 30 13:59:14 user nova-compute[74319]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 878706688 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] No waiting events found dispatching network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:15 user nova-compute[74319]: WARNING nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received unexpected event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 for instance with vm_state building and task_state spawning.
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] No waiting events found dispatching network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:15 user nova-compute[74319]: WARNING nova.compute.manager [req-17d88be0-3f23-4e35-98f6-22a99a2c34be req-16fa3faf-37dc-4dc8-8f6c-0c105b1ba9fe service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received unexpected event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 for instance with vm_state building and task_state spawning.
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.583s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:15 user nova-compute[74319]: INFO nova.compute.manager [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Successfully reverted task state from rebuilding on failure for instance.
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server [None req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Exception during message handling: ValueError: Circular reference detected
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     next(self.gen)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Oct 30 13:59:15 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 13:59:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 1012924416 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 req-3ec3c2e6-3581-419c-9a5b-80bed85c449c service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event volume-reimaged-05e121ec-970e-4e6a-8701-36f0febdac05 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 req-3ec3c2e6-3581-419c-9a5b-80bed85c449c service nova] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 req-3ec3c2e6-3581-419c-9a5b-80bed85c449c service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 req-3ec3c2e6-3581-419c-9a5b-80bed85c449c service nova] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-5f94d3cf-ea94-4bec-88a5-e8e70b891f06 req-3ec3c2e6-3581-419c-9a5b-80bed85c449c service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Processing event volume-reimaged-05e121ec-970e-4e6a-8701-36f0febdac05 {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TldGeoAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '6d473324-4b27-4d5b-a540-eba1228f2ab1'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:16 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c8e2a8-921f-4a3e-83e5-320add6db3cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:16 user nova-compute[74319]: No targets found.
Oct 30 13:59:16 user nova-compute[74319]: iSNS:
Oct 30 13:59:16 user nova-compute[74319]: No targets found.
Oct 30 13:59:16 user nova-compute[74319]: STATIC:
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:16 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:16 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:16 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:16 user nova-compute[74319]: No targets found.
Oct 30 13:59:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:16 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:16 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[219b46cd-e84a-4d6a-8397-2ea1084a8f1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a31e74a-e7b8-4797-8729-a722ee9a86d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:16 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998677640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 13:59:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Instance spawned successfully.
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18320cfa-9d7c-4365-92a9-3f1c19fb961d]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de39e75b-2766-4071-8c01-67dd0884bcbb]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b59e5f-6f56-4976-87f8-424b53ff9b7d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8826f71f-df8c-4e24-9623-644dad294cb6]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[80854ce1-95d9-467f-ae8d-e4e64ff5cfb5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: INFO nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Took 7.31 seconds to spawn the instance on the hypervisor.
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7b9a95-1c4a-43d2-ac35-50bb2d675f8b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260]
Oct 30 13:59:16 user nova-compute[74319]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:16 user nova-compute[74319]: INFO nova.compute.manager [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Took 8.59 seconds to build instance.
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-65906c59-1bcb-45e7-94df-4d9dfe0b344b tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.703s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d473324-4b27-4d5b-a540-eba1228f2ab1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d81e6-8976-40f2-a611-6d5c4c979816]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] <== disconnect_volume: return (374ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4', 'attached_at': '', 'detached_at': '', 'volume_id': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'serial'} {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: removing Cinder connection for volume 6d473324-4b27-4d5b-a540-eba1228f2ab1 {{(pid=74319) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 30 13:59:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] swap_volume: Updating volume 6d473324-4b27-4d5b-a540-eba1228f2ab1 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "TxCNpYmg", "auth_password": "B5CNsjfiPdc0yh", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "7f39bac7-e22f-44f7-9b2e-f9740d4d8159"}, "status": "reserved", "instance": "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4", "attached_at": "", "detached_at": "", "volume_id": "7f39bac7-e22f-44f7-9b2e-f9740d4d8159", "serial": "7f39bac7-e22f-44f7-9b2e-f9740d4d8159"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'no_device': None, 'attachment_id': '7418e1da-0124-4216-b298-46ff6c9bba20'} {{(pid=74319) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 30 13:59:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-069924da-0fa8-4619-a27b-9c65e192ccc6 tempest-TestVolumeSwap-18089966 tempest-TestVolumeSwap-18089966-project-admin] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 32.693s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:19 user nova-compute[74319]: INFO nova.compute.manager [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Detaching volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-changed-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Refreshing instance network info cache due to event network-changed-d249fb65-92e3-468f-a94f-8a97f66d95c1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] Acquiring lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] Acquired lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Refreshing network info cache for port d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:59:19 user nova-compute[74319]: INFO nova.virt.block_device [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Attempting to driver detach volume 7f39bac7-e22f-44f7-9b2e-f9740d4d8159 from mountpoint /dev/vdb
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Attempting to detach device vdb from instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:59:19 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:59:19 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 13:59:19 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:59:19 user nova-compute[74319]:   <serial>7f39bac7-e22f-44f7-9b2e-f9740d4d8159</serial>
Oct 30 13:59:19 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:59:19 user nova-compute[74319]: </disk>
Oct 30 13:59:19 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:59:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Successfully detached device vdb from instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 from the persistent domain config.
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 13:59:19 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 13:59:19 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 13:59:19 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 13:59:19 user nova-compute[74319]:   <serial>7f39bac7-e22f-44f7-9b2e-f9740d4d8159</serial>
Oct 30 13:59:19 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 13:59:19 user nova-compute[74319]: </disk>
Oct 30 13:59:19 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:19 user nova-compute[74319]: INFO nova.compute.manager [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Terminating instance
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updated VIF entry in instance network info cache for port d249fb65-92e3-468f-a94f-8a97f66d95c1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updating instance_info_cache with network_info: [{"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9215a755-f8f1-4be4-82e2-9dfcfd79772b req-cfbfa53f-451e-4890-ac91-91248a5587f1 service nova] Releasing lock "refresh_cache-cf3fa11e-80b3-431c-945a-0ab17f07c5b3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:19 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-unplugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] No waiting events found dispatching network-vif-unplugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-ba810682-5984-4954-af50-27b76aaafa51 req-2005d366-08cb-49e9-84e8-f45a4826fef4 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-unplugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Instance destroyed successfully.
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'resources' on Instance uuid cf3fa11e-80b3-431c-945a-0ab17f07c5b3 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:57:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548470189',display_name='tempest-AttachVolumeNegativeTest-server-1548470189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548470189',id=11,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAKZXvpqeVJ2cQHBORJmeu5dRHswoGJaHzxRZu3PiViY5yYJnBja5K9fT3zZh9f/pczAT6w35cLvvVGd+eY2hW8Js7G6goqExMRorPboyM/tKvmuVXaJ9wQdCfQfxBgOPA==',key_name='tempest-keypair-1014163901',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40pt251u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=cf3fa11e-80b3-431c-945a-0ab17f07c5b3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "address": "fa:16:3e:78:cd:94", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd249fb65-92", "ovs_interfaceid": "d249fb65-92e3-468f-a94f-8a97f66d95c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG os_vif [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd249fb65-92, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a869c9eb-3487-4f5e-bd96-b7b5f0e37bbe) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:20 user nova-compute[74319]: INFO os_vif [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:cd:94,bridge_name='br-int',has_traffic_filtering=True,id=d249fb65-92e3-468f-a94f-8a97f66d95c1,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd249fb65-92')
Oct 30 13:59:20 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Deleting instance files /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3_del
Oct 30 13:59:20 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Deletion of /opt/stack/data/nova/instances/cf3fa11e-80b3-431c-945a-0ab17f07c5b3_del complete
Oct 30 13:59:20 user nova-compute[74319]: INFO nova.compute.manager [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 30 13:59:20 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:21 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Took 0.88 seconds to deallocate network for instance.
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:21 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Error from libvirt while getting description of instance-0000000b: [Error Code 42] Domain not found: no domain with matching uuid 'cf3fa11e-80b3-431c-945a-0ab17f07c5b3' (instance-0000000b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'cf3fa11e-80b3-431c-945a-0ab17f07c5b3' (instance-0000000b)
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] Acquiring lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] No waiting events found dispatching network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:22 user nova-compute[74319]: WARNING nova.compute.manager [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received unexpected event network-vif-plugged-d249fb65-92e3-468f-a94f-8a97f66d95c1 for instance with vm_state deleted and task_state None.
Oct 30 13:59:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-c6565615-9a20-4052-900a-d8e7b8406b0b req-0966171e-a1b2-41ad-91ad-c2b817362472 service nova] [instance: cf3fa11e-80b3-431c-945a-0ab17f07c5b3] Received event network-vif-deleted-d249fb65-92e3-468f-a94f-8a97f66d95c1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:22 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Deleted allocations for instance cf3fa11e-80b3-431c-945a-0ab17f07c5b3
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c47cb30f-4c10-46b0-b5b1-f94409fbbc54 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "cf3fa11e-80b3-431c-945a-0ab17f07c5b3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdk (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdl (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdm (vdc) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 13:59:24 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:59:24 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=25.61037826538086GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 522d8b87-0d8c-42b5-9dfd-d64b8754d64d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 13:59:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 13:59:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [{"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-cb0d74e0-4263-4ee2-9db1-1615dd7efa24" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:32 user nova-compute[74319]: INFO nova.compute.manager [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Terminating instance
Oct 30 13:59:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-unplugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-unplugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8004f7a-7773-4747-8c0a-86826aacb42d req-301e13f1-1e09-4ff5-82ea-8935b24066d4 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-unplugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Instance destroyed successfully.
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lazy-loading 'resources' on Instance uuid 279dca02-f5a2-44cb-9c37-3802a64e7901 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2035355336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2035355336',id=6,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiLIX+n5XNczRifD2hbpQ9BFPEmPyaoMPPiLsdofcYsjW2f4YSQzwBh4U6zWNKkC0raFGJr8CfCerTjLzp93CNYoeIA2Tl0AC4ypNqbA+GzeITEzj5wRgMu+6D1RsvSWQ==',key_name='tempest-keypair-806139843',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e9adc75880c451b9ec528bcb47ca8dc',ramdisk_id='',reservation_id='r-60f2euin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-926275015',owner_user_name='tempest-TaggedAttachmentsTest-926275015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be414360ec564f668e2b0704981a231c',uuid=279dca02-f5a2-44cb-9c37-3802a64e7901,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converting VIF {"id": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "address": "fa:16:3e:ea:e3:d4", "network": {"id": "47983752-5ac0-4501-9ae5-e1bafe9028a5", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-397350864-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.203", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e9adc75880c451b9ec528bcb47ca8dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap007cce73-57", "ovs_interfaceid": "007cce73-5719-4d78-a8ee-eb979da7f5a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG os_vif [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap007cce73-57, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4b327fe5-401b-4120-aef2-2717a8d51bcf) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:33 user nova-compute[74319]: INFO os_vif [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:e3:d4,bridge_name='br-int',has_traffic_filtering=True,id=007cce73-5719-4d78-a8ee-eb979da7f5a6,network=Network(47983752-5ac0-4501-9ae5-e1bafe9028a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap007cce73-57')
Oct 30 13:59:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Deleting instance files /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901_del
Oct 30 13:59:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Deletion of /opt/stack/data/nova/instances/279dca02-f5a2-44cb-9c37-3802a64e7901_del complete
Oct 30 13:59:33 user nova-compute[74319]: INFO nova.compute.manager [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 30 13:59:33 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:59:33 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:34 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Took 0.85 seconds to deallocate network for instance.
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-d88d1be9-72fa-4aed-a4b8-2349e2e4dc7d req-df0ce29d-e238-4ed1-844e-5dead1544833 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-deleted-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:34 user nova-compute[74319]: INFO nova.compute.manager [req-d88d1be9-72fa-4aed-a4b8-2349e2e4dc7d req-df0ce29d-e238-4ed1-844e-5dead1544833 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Neutron deleted interface 007cce73-5719-4d78-a8ee-eb979da7f5a6; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-d88d1be9-72fa-4aed-a4b8-2349e2e4dc7d req-df0ce29d-e238-4ed1-844e-5dead1544833 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-d88d1be9-72fa-4aed-a4b8-2349e2e4dc7d req-df0ce29d-e238-4ed1-844e-5dead1544833 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Detach interface failed, port_id=007cce73-5719-4d78-a8ee-eb979da7f5a6, reason: Instance 279dca02-f5a2-44cb-9c37-3802a64e7901 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:34 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Deleted allocations for instance 279dca02-f5a2-44cb-9c37-3802a64e7901
Oct 30 13:59:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c56f207b-770b-4445-952f-4f67a2bcea20 tempest-TaggedAttachmentsTest-926275015 tempest-TaggedAttachmentsTest-926275015-project-member] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.319s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] Acquiring lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] Lock "279dca02-f5a2-44cb-9c37-3802a64e7901-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] No waiting events found dispatching network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:34 user nova-compute[74319]: WARNING nova.compute.manager [req-343a23f4-28be-4e42-8eac-da48635ba380 req-93ae1dc4-30d1-49e8-a002-6de0b94a1132 service nova] [instance: 279dca02-f5a2-44cb-9c37-3802a64e7901] Received unexpected event network-vif-plugged-007cce73-5719-4d78-a8ee-eb979da7f5a6 for instance with vm_state deleted and task_state None.
Oct 30 13:59:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:39 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 is timed out.
Oct 30 13:59:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Successfully detached device vdb from instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 from the live domain config.
Oct 30 13:59:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxCNpYmg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': '7f39bac7-e22f-44f7-9b2e-f9740d4d8159'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:39 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[37846354-1bf6-4469-954c-1e0546da59f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:39 user nova-compute[74319]: No targets found.
Oct 30 13:59:39 user nova-compute[74319]: iSNS:
Oct 30 13:59:39 user nova-compute[74319]: No targets found.
Oct 30 13:59:39 user nova-compute[74319]: STATIC:
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:39 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:39 user nova-compute[74319]: No targets found.
Oct 30 13:59:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:39 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:39 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f4efda-6d2e-4550-a3b7-65a0850a572a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a06a79-f99f-4165-a4ee-fb6d5249e8e7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:40 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99852a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159'): ({'sdh'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Removing single pathed devices sdh {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a021a85-de82-4a3f-b58e-c784351b5697]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653246d-7934-44ae-9f29-4608c7102cc7]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Flushing IO for device /dev/sdh {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a187d-7392-40bf-8dce-b8ca5a228a7f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d834bc69-acac-4399-b966-b428819e3a30]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a535e0d9-d0b0-41a0-9607-3a8c3e1a502a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4695a368-59ff-4ad8-a8e9-e82a2cfde4e4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260]
Oct 30 13:59:40 user nova-compute[74319]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f39bac7-e22f-44f7-9b2e-f9740d4d8159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c422ce0-79ca-4558-afea-e23f094aadae]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-changed-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing instance network info cache due to event network-changed-f2757f95-16d0-4e3b-9696-adb3c8920856. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] Acquiring lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] Acquired lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG nova.network.neutron [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Refreshing network info cache for port f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] <== disconnect_volume: return (445ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-changed-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing instance network info cache due to event network-changed-993d868c-2638-4168-9bcb-6aa370bb9258. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] Acquiring lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] Acquired lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Refreshing network info cache for port 993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lazy-loading 'flavor' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03d7ebcc-1e6c-4cb3-8a8b-339e5298b4dd tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.369s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updated VIF entry in instance network info cache for port f2757f95-16d0-4e3b-9696-adb3c8920856. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27c363ef-4270-471a-a2bd-bf429a401a37 req-ef6b3c2b-5b4c-47f1-9fd1-57f9575e2349 service nova] Releasing lock "refresh_cache-ea67d25b-9010-4f0a-bf43-9e2483cc859c" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updated VIF entry in instance network info cache for port 993d868c-2638-4168-9bcb-6aa370bb9258. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a86a61e0-20de-4726-bf38-e8dfc496bad8 req-850942d6-471c-4773-8469-375648f9a0f0 service nova] Releasing lock "refresh_cache-4fae7c1c-745c-41b6-a682-c40e6d507b0d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:43 user nova-compute[74319]: INFO nova.compute.manager [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Terminating instance
Oct 30 13:59:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-b21d4d3f-a1bf-452b-ad47-2908b48788e8 req-91ed3a99-27c5-48fb-a396-59a61474fb76 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-f2757f95-16d0-4e3b-9696-adb3c8920856 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:44 user nova-compute[74319]: INFO nova.compute.manager [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Terminating instance
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-7452dd24-0232-4df5-a1e1-3c2571c44bbe req-0bb5a347-e882-4246-aa68-4925d61ea88d service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc74ad08-f22d-41b7-8fda-573085a5c860 req-9d30bb63-a9ff-4010-8bca-ca44e38d03b4 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Instance destroyed successfully.
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lazy-loading 'resources' on Instance uuid ea67d25b-9010-4f0a-bf43-9e2483cc859c {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f2757f95-16d0-4e3b-9696-adb3c8920856", "address": "fa:16:3e:35:28:35", "network": {"id": "71da07df-fb9e-4630-87be-74f17880ec5e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1902216529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2757f95-16", "ovs_interfaceid": "f2757f95-16d0-4e3b-9696-adb3c8920856", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2757f95-16, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: WARNING nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f2757f95-16d0-4e3b-9696-adb3c8920856 for instance with vm_state active and task_state deleting.
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-2eab49af-373e-46f0-91d9-d842b75b8d3f for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: WARNING nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-2eab49af-373e-46f0-91d9-d842b75b8d3f for instance with vm_state active and task_state deleting.
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-993d868c-2638-4168-9bcb-6aa370bb9258 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: WARNING nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-993d868c-2638-4168-9bcb-6aa370bb9258 for instance with vm_state active and task_state deleting.
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-afa1bbd3-1b4f-49cb-98bd-09089d1d9f18 req-e0fabaa8-7de1-40b7-8f3b-4650ae01a7d5 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8bbc707-aa00-4702-839b-72d373da4023) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Instance destroyed successfully.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.objects.instance [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lazy-loading 'resources' on Instance uuid 4fae7c1c-745c-41b6-a682-c40e6d507b0d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "993d868c-2638-4168-9bcb-6aa370bb9258", "address": "fa:16:3e:5c:a8:2d", "network": {"id": "3c2cb181-5a47-43bf-80f3-27a49b248b5d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-395027049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap993d868c-26", "ovs_interfaceid": "993d868c-2638-4168-9bcb-6aa370bb9258", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap993d868c-26, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:35:28:35,bridge_name='br-int',has_traffic_filtering=True,id=f2757f95-16d0-4e3b-9696-adb3c8920856,network=Network(71da07df-fb9e-4630-87be-74f17880ec5e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2757f95-16')
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1 for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-unplugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-unplugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-738547bc-e918-4ad8-9dd2-f200dee5daeb for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a0ba15-2ed7-4f72-9d2c-b48f05088567 req-90259c25-d297-45af-a0b3-36577cea368e service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-738547bc-e918-4ad8-9dd2-f200dee5daeb for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1989ad9e-b3, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aded9b5-91c6-4174-9d90-dada2c3c8a38) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-da0ac42f-e842-4c4b-a7c8-690bd3679fab for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-bc01d474-0eab-48f5-841c-8fce27706c20 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:46 user nova-compute[74319]: WARNING nova.compute.manager [req-4d8235dc-83e8-46ae-ad4e-092212f19504 req-497fc86b-8dba-4023-9507-741e3fe89831 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-bc01d474-0eab-48f5-841c-8fce27706c20 for instance with vm_state active and task_state deleting.
Oct 30 13:59:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9136139c-3bce-47e4-a7c0-c3f5f225af7c) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:a8:2d,bridge_name='br-int',has_traffic_filtering=True,id=993d868c-2638-4168-9bcb-6aa370bb9258,network=Network(3c2cb181-5a47-43bf-80f3-27a49b248b5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap993d868c-26')
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda0ac42f-e8, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:4f:98,bridge_name='br-int',has_traffic_filtering=True,id=1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1989ad9e-b3')
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eab49af-37, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56d61b88-66c7-4377-a21b-7bdfe3b28ea5) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c7a4086-b60f-414f-b4ae-aea7d9ded5ad) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:b9:af,bridge_name='br-int',has_traffic_filtering=True,id=da0ac42f-e842-4c4b-a7c8-690bd3679fab,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapda0ac42f-e8')
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7b3aa7b-87, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:ab:5d,bridge_name='br-int',has_traffic_filtering=True,id=2eab49af-373e-46f0-91d9-d842b75b8d3f,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2eab49af-37')
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fe430f4-cc, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c29e3aa-745d-40d6-a992-e070bfaa02b3) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd41e4aa-4ac4-491f-85b0-36d11b570107) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:47 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:60:f3,bridge_name='br-int',has_traffic_filtering=True,id=b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb7b3aa7b-87')
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78d89f62-5c, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:5c:4e,bridge_name='br-int',has_traffic_filtering=True,id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe430f4-cc')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] No waiting events found dispatching network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received unexpected event network-vif-plugged-f75f6f1a-cf5c-4f98-8391-a0f12a825252 for instance with vm_state active and task_state deleting.
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52 for instance with vm_state active and task_state deleting.
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-78d89f62-5c8d-4037-8cc5-75197a31f61e for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-78d89f62-5c8d-4037-8cc5-75197a31f61e for instance with vm_state active and task_state deleting.
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-unplugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-unplugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Acquiring lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] No waiting events found dispatching network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING nova.compute.manager [req-f2f81e7a-3464-4dfa-a08a-bb5467ae8398 req-ce38e8a2-30e2-4b18-8bea-fd3fbae8d9a1 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received unexpected event network-vif-plugged-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 for instance with vm_state active and task_state deleting.
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d9f1aac-73, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=23ad2646-1df4-46a0-9caa-5c96d0e6ed44) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f29ba84f-f010-44f3-a815-ec10531d25de) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:62:5e,bridge_name='br-int',has_traffic_filtering=True,id=78d89f62-5c8d-4037-8cc5-75197a31f61e,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d89f62-5c')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738547bc-e9, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:5a:c8,bridge_name='br-int',has_traffic_filtering=True,id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0,network=Network(88c74a53-bd40-4c15-9bdc-5c11094dbbb4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d9f1aac-73')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b6dbaf0-9d, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b3de137-3722-4574-845f-be1f77d9b38a) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16baf0e0-8310-4fa4-9f9e-2d6c955872e2) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:58:c1,bridge_name='br-int',has_traffic_filtering=True,id=738547bc-e918-4ad8-9dd2-f200dee5daeb,network=Network(5b5ac9e1-153c-41f3-8659-e27bd99cd4b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738547bc-e9')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc01d474-0e, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:2a:a2,bridge_name='br-int',has_traffic_filtering=True,id=8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6dbaf0-9d')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1625945478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1625945478',id=10,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2872XMuBXCBxzRKzUAAIolwTkExeGrmBZgYUdSOGRsQx5/tjU66Qz4MLd80PgrQ9dgEJGT5qMbZrH35Kl4l/zbg/JHXxcVYLxEGBfm7mQ1nB9j6OM5tsRUJ6Xb7oEuLA==',key_name='tempest-keypair-1414494412',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b92b41eede4ba1873ca7c4574d31e5',ramdisk_id='',reservation_id='r-735u4b9z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1140656183',owner_user_name='tempest-TaggedBootDevicesTest-1140656183-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0383d20b22434a7fb704e65226cf66ce',uuid=ea67d25b-9010-4f0a-bf43-9e2483cc859c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converting VIF {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf75f6f1a-cf, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa93e26b-2ed4-4825-90ad-12b7bead72d1) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33160d25-7405-4c29-bbd5-f02b88853157) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:aa:1a,bridge_name='br-int',has_traffic_filtering=True,id=bc01d474-0eab-48f5-841c-8fce27706c20,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc01d474-0e')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-30T13:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1354532689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1354532689',id=9,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY7sFM5B+hmSK/mAg5k8q0OkyEzGsfUk4qaG5AAEz4tBN61TBscM3yF6rWn5QT3wqGl1AtOmDbIhkIJtbMIot0X25vDyfa2O+tSvYNAUJ83t6h8b0zmsHIiop6C5MyAew==',key_name='tempest-keypair-166826036',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f7f4d7b5d57b48bb99b757884cfb1e74',ramdisk_id='',reservation_id='r-lc95ob29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-631515063',owner_user_name='tempest-TaggedBootDevicesTest_v242-631515063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:58:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad3a7be151634bfd9316ddb7cc8fb716',uuid=4fae7c1c-745c-41b6-a682-c40e6d507b0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converting VIF {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap56c44b1b-00, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:b9:f7,bridge_name='br-int',has_traffic_filtering=True,id=f75f6f1a-cf5c-4f98-8391-a0f12a825252,network=Network(991bc58a-4376-43c6-98b0-4c5bfe517220),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf75f6f1a-cf')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb4da3b2-f22f-42db-8595-e18c2de9d4dd) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ljzFXItc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: INFO os_vif [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:f5:f2,bridge_name='br-int',has_traffic_filtering=True,id=56c44b1b-00c2-47ce-b2a5-3a01ff177c59,network=Network(664370c3-0426-4270-a62a-d5b1f48e49ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap56c44b1b-00')
Oct 30 13:59:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxjZcotY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:48 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6922bda-ff32-4333-8235-9f31968a7745]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:48 user nova-compute[74319]: No targets found.
Oct 30 13:59:48 user nova-compute[74319]: iSNS:
Oct 30 13:59:48 user nova-compute[74319]: No targets found.
Oct 30 13:59:48 user nova-compute[74319]: STATIC:
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:48 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:48 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:48 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:48 user nova-compute[74319]: No targets found.
Oct 30 13:59:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:48 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:48 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[04836aa5-5c60-4934-b586-232b8aa37d09]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ebbeb9-201a-462b-ab49-4c803a7cbd9d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:48 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998675a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a'): ({'sdf'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Removing single pathed devices sdf {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[17596ebe-4b96-48d7-83d0-67e21b0f393e]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99935574-1d45-4848-b9f0-46020579e679]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Flushing IO for device /dev/sdf {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7c9b7e-787e-448a-96ed-bc417e26acc8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c26a55-b1af-4431-b4ec-e56f3505fdb9]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df6578d-4e4d-48c6-8c50-fc0a04986c20]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26c3ea9-651c-4c53-83f0-423f39b43cf5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260]
Oct 30 13:59:49 user nova-compute[74319]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6abbac29-245b-41c6-a8ae-c612a411e37a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[246533f0-7e04-484a-86e4-956ce147798d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== disconnect_volume: return (383ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.370s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mncUKeWu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:49 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b141d62-6a5c-4468-a5e8-9bb7b335bc3f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: iSNS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: STATIC:
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:49 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6aa970-cba3-44bf-a524-73c378722ab5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d00fb8-c8a3-42d1-9d2f-e004490986aa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998675a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b'): ({'sdk'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Removing single pathed devices sdk {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d8089-027c-46a7-b854-e4aecc37d7bb]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d9c28-a1ab-47a8-bf64-6d0c7ab63a37]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Flushing IO for device /dev/sdk {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06512e5-a052-4546-9a96-862e4e54ee87]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.047s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd481746-6ef9-423e-a49b-0eef09e873ab]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] SCSI volumes sdk have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba4a3e0-9bf1-48ce-888b-1f2db9c3871b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[058365b2-dd1c-4de0-9716-154d5d583cd3]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260]
Oct 30 13:59:49 user nova-compute[74319]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d96cdd8e-a0c9-4226-a7f3-6d49c37f5a5b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d5a5da-4308-461a-9208-6926a2e5bf4e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== disconnect_volume: return (719ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.346s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xhsigoud', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:49 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd07b13b-e79a-4eca-b55c-3587fd1aaa2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: iSNS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: STATIC:
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:49 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[66de56ac-2f8d-4863-ab7b-6c0c7e08ae03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e2a439-768d-429e-af97-10914e12fca5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998675a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0346bf-7be5-48ed-861f-1aa861474566]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6654dbc1-75f4-4675-bc22-c411fd414098]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb5bcd-4f74-4333-a0d6-1276fec7545e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0ccf0-8c26-48ff-88fb-7b86421cd912]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3ef09-381e-4ff6-99a5-ea232c7af819]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[018de0f7-ba01-4798-baa8-2bceedbe5b96]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260]
Oct 30 13:59:49 user nova-compute[74319]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f61580e2-fad5-45ba-af71-d69ab8f62c5e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e6c24a-3e0a-4596-851f-b5e16af5985d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== disconnect_volume: return (658ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MZDhuaLz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:49 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c620144-76fa-4348-b671-1070dd0ea3df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: iSNS:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]: STATIC:
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:49 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:49 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:49 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:49 user nova-compute[74319]: No targets found.
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:49 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:49 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90c7c7-a48b-4e15-b7d2-5b20248c735e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb59019-dcd4-4d7e-883e-fda10ebc4217]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:49 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998675a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29'): ({'sdl'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Removing single pathed devices sdl {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a04f291-1547-4e96-89f9-8ec82abb6922]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dc05b8-f7ef-4035-bf20-407cbcb5a7f2]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Flushing IO for device /dev/sdl {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d44a22-f2ae-4a16-a6e3-dd7676e12b6d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9fa53d-8abb-4a5f-8328-246199cbc82b]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] SCSI volumes sdl have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f95a11-7fb7-41c0-9a3b-546ee8f5d872]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c9f72-9474-48bc-951c-2767f28cfc35]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260]
Oct 30 13:59:50 user nova-compute[74319]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ef92531-9ece-46b1-a8dd-64a5e12f7e29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b370df9-2c96-4ce5-a4cf-7f6769cf9dc8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== disconnect_volume: return (634ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.321s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yGEsCOYp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 13:59:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7d39eb-af3e-470c-8962-07450cfcc317]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]: iSNS:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]: STATIC:
Oct 30 13:59:50 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9
Oct 30 13:59:50 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:50 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:50 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:50 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:50 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:50 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:50 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:50 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:50 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:50 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:50 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b21b4e5-a93a-4df6-8038-d802ea23cc2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[345516d0-9790-4787-9b38-9f3b0dee8574]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998277760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9'): ({'sdg'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Removing single pathed devices sdg {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[08de82f4-99db-4300-841a-1f222a13a26c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb06b134-5700-495e-8164-6a0cf0936b5c]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Flushing IO for device /dev/sdg {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16b1183-c8eb-4caf-8d03-5d3451605cb0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[727bc9c6-16f9-4286-a98f-8cd4884d632c]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] SCSI volumes sdg have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c27a09-fbfa-48b9-97a9-ff9c3b1a4631]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe92571-8e6e-49f1-8ac4-332e47321766]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260]
Oct 30 13:59:50 user nova-compute[74319]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80a561-b2c7-4f2e-ba3d-c3f839ed7ea9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[401631b3-c85d-459d-9ce8-f00db88ce3d6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] <== disconnect_volume: return (610ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Deleting instance files /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c_del
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Deletion of /opt/stack/data/nova/instances/ea67d25b-9010-4f0a-bf43-9e2483cc859c_del complete
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.290s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ef5218-4eb4-4637-adb6-8e7204df8db2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]: iSNS:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]: STATIC:
Oct 30 13:59:50 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 13:59:50 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:50 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:50 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08
Oct 30 13:59:50 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 13:59:50 user nova-compute[74319]:                 Iface Name: default
Oct 30 13:59:50 user nova-compute[74319]: FIRMWARE:
Oct 30 13:59:50 user nova-compute[74319]: No targets found.
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 13:59:50 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 13:59:50 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b796fe94-76f6-4afe-9fab-4842bac63853]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.compute.manager [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Took 6.98 seconds to destroy the instance on the hypervisor.
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5889a32d-6c99-41ec-956f-317ef2c8fdfe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9984468c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08'): ({'sdm'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Removing single pathed devices sdm {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e330476-14b2-42f6-8e63-0a92b8552172]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a689a681-0d56-4f09-a3dc-b3c5052dd1e7]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Flushing IO for device /dev/sdm {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce90373-60f6-4c2d-a5d1-c73f1914d989]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd40488-8cca-4d03-9023-502f9293826c]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] SCSI volumes sdm have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d43a19-6ed5-43fd-8a33-77bfb8fc1814]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f21c954-9675-45a0-887a-f3fef9bcbe91]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260]
Oct 30 13:59:50 user nova-compute[74319]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08, portal: 172.16.0.220,3260] successful.
Oct 30 13:59:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dd7e3a6-c5b7-423e-a409-af6153226c08 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be0194b-a875-46f0-bb36-0b852f5bf572]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] <== disconnect_volume: return (673ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Deleting instance files /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d_del
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Deletion of /opt/stack/data/nova/instances/4fae7c1c-745c-41b6-a682-c40e6d507b0d_del complete
Oct 30 13:59:50 user nova-compute[74319]: INFO nova.compute.manager [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Took 6.76 seconds to destroy the instance on the hypervisor.
Oct 30 13:59:50 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 13:59:50 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 13:59:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 13:59:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-7fdef655-bbbf-43bf-88ad-cd7fa1fff40d req-743f2d33-fa95-4d06-ae60-90ad02d72661 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-deleted-f2757f95-16d0-4e3b-9696-adb3c8920856 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:54 user nova-compute[74319]: INFO nova.compute.manager [req-7fdef655-bbbf-43bf-88ad-cd7fa1fff40d req-743f2d33-fa95-4d06-ae60-90ad02d72661 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Neutron deleted interface f2757f95-16d0-4e3b-9696-adb3c8920856; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-7fdef655-bbbf-43bf-88ad-cd7fa1fff40d req-743f2d33-fa95-4d06-ae60-90ad02d72661 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "address": "fa:16:3e:f9:5c:4e", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.118", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe430f4-cc", "ovs_interfaceid": "5fe430f4-ccb6-40c5-b161-b05ef94daeb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-7fdef655-bbbf-43bf-88ad-cd7fa1fff40d req-743f2d33-fa95-4d06-ae60-90ad02d72661 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Detach interface failed, port_id=f2757f95-16d0-4e3b-9696-adb3c8920856, reason: Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-deleted-993d868c-2638-4168-9bcb-6aa370bb9258 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:56 user nova-compute[74319]: INFO nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Neutron deleted interface 993d868c-2638-4168-9bcb-6aa370bb9258; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc01d474-0eab-48f5-841c-8fce27706c20", "address": "fa:16:3e:d6:aa:1a", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc01d474-0e", "ovs_interfaceid": "bc01d474-0eab-48f5-841c-8fce27706c20", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Detach interface failed, port_id=993d868c-2638-4168-9bcb-6aa370bb9258, reason: Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-deleted-5fe430f4-ccb6-40c5-b161-b05ef94daeb4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:56 user nova-compute[74319]: INFO nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Neutron deleted interface 5fe430f4-ccb6-40c5-b161-b05ef94daeb4; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "address": "fa:16:3e:66:5a:c8", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d9f1aac-73", "ovs_interfaceid": "4d9f1aac-73a6-4a38-b55f-a1b07d6302d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Detach interface failed, port_id=5fe430f4-ccb6-40c5-b161-b05ef94daeb4, reason: Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-deleted-bc01d474-0eab-48f5-841c-8fce27706c20 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:56 user nova-compute[74319]: INFO nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Neutron deleted interface bc01d474-0eab-48f5-841c-8fce27706c20; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "address": "fa:16:3e:18:62:5e", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.196", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d89f62-5c", "ovs_interfaceid": "78d89f62-5c8d-4037-8cc5-75197a31f61e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Detach interface failed, port_id=bc01d474-0eab-48f5-841c-8fce27706c20, reason: Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-deleted-4d9f1aac-73a6-4a38-b55f-a1b07d6302d0 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:56 user nova-compute[74319]: INFO nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Neutron deleted interface 4d9f1aac-73a6-4a38-b55f-a1b07d6302d0; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [{"id": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "address": "fa:16:3e:18:4f:98", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1989ad9e-b3", "ovs_interfaceid": "1989ad9e-b3f3-4f05-b7b3-5a2c6c6abff1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "address": "fa:16:3e:6f:ab:5d", "network": {"id": "88c74a53-bd40-4c15-9bdc-5c11094dbbb4", "bridge": "br-int", "label": "tempest-device-tagging-net1-560862737", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab49af-37", "ovs_interfaceid": "2eab49af-373e-46f0-91d9-d842b75b8d3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "address": "fa:16:3e:ec:2a:a2", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6dbaf0-9d", "ovs_interfaceid": "8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "address": "fa:16:3e:8e:b9:f7", "network": {"id": "991bc58a-4376-43c6-98b0-4c5bfe517220", "bridge": "br-int", "label": "tempest-device-tagging-net2-1668974519", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "c4b92b41eede4ba1873ca7c4574d31e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf75f6f1a-cf", "ovs_interfaceid": "f75f6f1a-cf5c-4f98-8391-a0f12a825252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Detach interface failed, port_id=4d9f1aac-73a6-4a38-b55f-a1b07d6302d0, reason: Instance ea67d25b-9010-4f0a-bf43-9e2483cc859c could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-deleted-78d89f62-5c8d-4037-8cc5-75197a31f61e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:56 user nova-compute[74319]: INFO nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Neutron deleted interface 78d89f62-5c8d-4037-8cc5-75197a31f61e; detaching it from the instance and deleting it from the info cache
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [{"id": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "address": "fa:16:3e:3f:b9:af", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.178", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0ac42f-e8", "ovs_interfaceid": "da0ac42f-e842-4c4b-a7c8-690bd3679fab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "address": "fa:16:3e:c7:60:f3", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7b3aa7b-87", "ovs_interfaceid": "b7b3aa7b-87aa-4ae6-aa72-ad9933d32a52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "address": "fa:16:3e:e2:58:c1", "network": {"id": "5b5ac9e1-153c-41f3-8659-e27bd99cd4b7", "bridge": "br-int", "label": "tempest-device-tagging-net1-2094572141", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.31", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738547bc-e9", "ovs_interfaceid": "738547bc-e918-4ad8-9dd2-f200dee5daeb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "address": "fa:16:3e:6d:f5:f2", "network": {"id": "664370c3-0426-4270-a62a-d5b1f48e49ee", "bridge": "br-int", "label": "tempest-device-tagging-net2-1224888943", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f7f4d7b5d57b48bb99b757884cfb1e74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap56c44b1b-00", "ovs_interfaceid": "56c44b1b-00c2-47ce-b2a5-3a01ff177c59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-4c91c742-3c40-46c0-9889-18dbad050d8f req-3bd8f548-6072-4f38-b821-31bbaf7a7429 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Detach interface failed, port_id=78d89f62-5c8d-4037-8cc5-75197a31f61e, reason: Instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 13:59:57 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:57 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Took 6.78 seconds to deallocate network for instance.
Oct 30 13:59:57 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 13:59:57 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Took 6.69 seconds to deallocate network for instance.
Oct 30 13:59:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-95a0f8de-d669-4e5e-84f1-9d0a44fba455 req-b218ce61-61e1-425d-b40a-f94cc2d97e29 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-deleted-8b6dbaf0-9dec-4fc7-be53-1e2b341cd2e4 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-95a0f8de-d669-4e5e-84f1-9d0a44fba455 req-b218ce61-61e1-425d-b40a-f94cc2d97e29 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-deleted-56c44b1b-00c2-47ce-b2a5-3a01ff177c59 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-95a0f8de-d669-4e5e-84f1-9d0a44fba455 req-b218ce61-61e1-425d-b40a-f94cc2d97e29 service nova] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Received event network-vif-deleted-f75f6f1a-cf5c-4f98-8391-a0f12a825252 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-95a0f8de-d669-4e5e-84f1-9d0a44fba455 req-b218ce61-61e1-425d-b40a-f94cc2d97e29 service nova] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Received event network-vif-deleted-738547bc-e918-4ad8-9dd2-f200dee5daeb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 13:59:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 13:59:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:00 user nova-compute[74319]: INFO nova.compute.manager [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] [instance: ea67d25b-9010-4f0a-bf43-9e2483cc859c] Took 2.76 seconds to detach 3 volumes for instance.
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:00 user nova-compute[74319]: INFO nova.compute.manager [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] [instance: 4fae7c1c-745c-41b6-a682-c40e6d507b0d] Took 2.71 seconds to detach 3 volumes for instance.
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.119s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:00 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Deleted allocations for instance ea67d25b-9010-4f0a-bf43-9e2483cc859c
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c114172-0bd4-4fca-8d0a-9a23519d2120 tempest-TaggedBootDevicesTest-1140656183 tempest-TaggedBootDevicesTest-1140656183-project-member] Lock "ea67d25b-9010-4f0a-bf43-9e2483cc859c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 17.167s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:00 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Deleted allocations for instance 4fae7c1c-745c-41b6-a682-c40e6d507b0d
Oct 30 14:00:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-333c8c26-7f50-40f6-9355-5d9cc4086af5 tempest-TaggedBootDevicesTest_v242-631515063 tempest-TaggedBootDevicesTest_v242-631515063-project-member] Lock "4fae7c1c-745c-41b6-a682-c40e6d507b0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.985s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:00:04 user nova-compute[74319]: INFO nova.compute.claims [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Claim successful on node user
Oct 30 14:00:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:00:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.policy [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24eece1d8fbe4be482f6afc140f0b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0328481b34a30ab78698c9815c6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:00:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Creating image(s)
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "/opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "/opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Cannot resize image /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Ensure instance console log exists: /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Successfully created port: 4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Successfully updated port: 4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquired lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-changed-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Refreshing instance network info cache due to event network-changed-4b938e82-d39b-4642-ad79-ebcfaa828675. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] Acquiring lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updating instance_info_cache with network_info: [{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Releasing lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Instance network_info: |[{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] Acquired lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Refreshing network info cache for port 4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Start _get_guest_xml network_info=[{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:00:08 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:08 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855866068',display_name='tempest-ServersNegativeTestJSON-server-855866068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855866068',id=13,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-qu6gqtxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:06Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=5a08d5cb-f77c-46be-b0b8-5221c9f9ed32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:00:08 user nova-compute[74319]:   <uuid>5a08d5cb-f77c-46be-b0b8-5221c9f9ed32</uuid>
Oct 30 14:00:08 user nova-compute[74319]:   <name>instance-0000000d</name>
Oct 30 14:00:08 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:00:08 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:00:08 user nova-compute[74319]:   <metadata>
Oct 30 14:00:08 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:00:08 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:name>tempest-ServersNegativeTestJSON-server-855866068</nova:name>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:00:08</nova:creationTime>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:00:08 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:00:08 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:owner>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:user uuid="24eece1d8fbe4be482f6afc140f0b2fa">tempest-ServersNegativeTestJSON-1299330642-project-member</nova:user>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:project uuid="fea0328481b34a30ab78698c9815c6f5">tempest-ServersNegativeTestJSON-1299330642</nova:project>
Oct 30 14:00:08 user nova-compute[74319]:       </nova:owner>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:00:08 user nova-compute[74319]:       <nova:ports>
Oct 30 14:00:08 user nova-compute[74319]:         <nova:port uuid="4b938e82-d39b-4642-ad79-ebcfaa828675">
Oct 30 14:00:08 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 14:00:08 user nova-compute[74319]:         </nova:port>
Oct 30 14:00:08 user nova-compute[74319]:       </nova:ports>
Oct 30 14:00:08 user nova-compute[74319]:     </nova:instance>
Oct 30 14:00:08 user nova-compute[74319]:   </metadata>
Oct 30 14:00:08 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:00:08 user nova-compute[74319]:     <system>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="serial">5a08d5cb-f77c-46be-b0b8-5221c9f9ed32</entry>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="uuid">5a08d5cb-f77c-46be-b0b8-5221c9f9ed32</entry>
Oct 30 14:00:08 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:00:08 user nova-compute[74319]:     </system>
Oct 30 14:00:08 user nova-compute[74319]:   </sysinfo>
Oct 30 14:00:08 user nova-compute[74319]:   <os>
Oct 30 14:00:08 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:00:08 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:00:08 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:00:08 user nova-compute[74319]:   </os>
Oct 30 14:00:08 user nova-compute[74319]:   <features>
Oct 30 14:00:08 user nova-compute[74319]:     <acpi/>
Oct 30 14:00:08 user nova-compute[74319]:     <apic/>
Oct 30 14:00:08 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:00:08 user nova-compute[74319]:   </features>
Oct 30 14:00:08 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:00:08 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:00:08 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:00:08 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:00:08 user nova-compute[74319]:   </clock>
Oct 30 14:00:08 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:00:08 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:00:08 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:00:08 user nova-compute[74319]:   </cpu>
Oct 30 14:00:08 user nova-compute[74319]:   <devices>
Oct 30 14:00:08 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:00:08 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:00:08 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk"/>
Oct 30 14:00:08 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:00:08 user nova-compute[74319]:     </disk>
Oct 30 14:00:08 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:00:08 user nova-compute[74319]:       <mac address="fa:16:3e:26:30:5f"/>
Oct 30 14:00:08 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:08 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:00:08 user nova-compute[74319]:       <target dev="tap4b938e82-d3"/>
Oct 30 14:00:08 user nova-compute[74319]:     </interface>
Oct 30 14:00:08 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:00:08 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/console.log" append="off"/>
Oct 30 14:00:08 user nova-compute[74319]:     </serial>
Oct 30 14:00:08 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:00:08 user nova-compute[74319]:     <video>
Oct 30 14:00:08 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:08 user nova-compute[74319]:     </video>
Oct 30 14:00:08 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:00:08 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:00:08 user nova-compute[74319]:     </rng>
Oct 30 14:00:08 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:00:08 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:00:08 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:00:08 user nova-compute[74319]:     </memballoon>
Oct 30 14:00:08 user nova-compute[74319]:   </devices>
Oct 30 14:00:08 user nova-compute[74319]: </domain>
Oct 30 14:00:08 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855866068',display_name='tempest-ServersNegativeTestJSON-server-855866068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855866068',id=13,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-qu6gqtxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:06Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=5a08d5cb-f77c-46be-b0b8-5221c9f9ed32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG os_vif [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b76f4597-833c-5a3a-a684-21541afc3746', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b938e82-d3, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b938e82-d3, col_values=(('qos', UUID('ac2e74f3-07e7-41ed-b17f-3ec0d96764ed')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b938e82-d3, col_values=(('external_ids', {'iface-id': '4b938e82-d39b-4642-ad79-ebcfaa828675', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:30:5f', 'vm-uuid': '5a08d5cb-f77c-46be-b0b8-5221c9f9ed32'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:08 user nova-compute[74319]: INFO os_vif [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3')
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] No VIF found with MAC fa:16:3e:26:30:5f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updated VIF entry in instance network info cache for port 4b938e82-d39b-4642-ad79-ebcfaa828675. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updating instance_info_cache with network_info: [{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0f5641b9-9c38-4b4a-9222-080305e01828 req-e4c26823-0c6c-48f9-ba4b-478aa415547e service nova] Releasing lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:09 user nova-compute[74319]: INFO nova.compute.manager [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Terminating instance
Oct 30 14:00:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:00:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] No waiting events found dispatching network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:10 user nova-compute[74319]: WARNING nova.compute.manager [req-5ed7145f-605c-4ba9-baa4-01c2273f7278 req-36e2a2ef-21da-4dcf-ba8e-12e98eb5b8ea service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received unexpected event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 for instance with vm_state building and task_state spawning.
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-unplugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] No waiting events found dispatching network-vif-unplugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d72a830-bd86-4919-856b-c2a8212af57b req-05e498b8-cf69-4b65-94c7-1481187d11fc service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-unplugged-90db37ff-95ac-4232-9116-f20a7ab74a27 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Instance destroyed successfully.
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lazy-loading 'resources' on Instance uuid 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-847837838',display_name='tempest-TestVolumeSwap-server-847837838',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-847837838',id=4,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLstNsD34LDlNlwy7g8gtxr2IQeYjZCHoipO/ZQuTb29rwBG4Nx/Tohzl610+1ffGXELlkcn3bGQ5pptM2ypYvN+0aHAHz3+OiTiQUyrIHihxlVcb/OsFNALR6HTz4pxPw==',key_name='tempest-keypair-2139898388',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ad088e24dd644c29c48c1e4222ad186',ramdisk_id='',reservation_id='r-egy0kk4o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-207996520',owner_user_name='tempest-TestVolumeSwap-207996520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca76c949d242412ebc0bcedc358857a5',uuid=1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converting VIF {"id": "90db37ff-95ac-4232-9116-f20a7ab74a27", "address": "fa:16:3e:4a:db:68", "network": {"id": "fc4af1ca-d704-44ad-9ca5-ec6323967d81", "bridge": "br-int", "label": "tempest-TestVolumeSwap-612274609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ad088e24dd644c29c48c1e4222ad186", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90db37ff-95", "ovs_interfaceid": "90db37ff-95ac-4232-9116-f20a7ab74a27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG os_vif [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90db37ff-95, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f71b1d3f-10e8-4d74-a025-d4902576f16d) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: INFO os_vif [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:db:68,bridge_name='br-int',has_traffic_filtering=True,id=90db37ff-95ac-4232-9116-f20a7ab74a27,network=Network(fc4af1ca-d704-44ad-9ca5-ec6323967d81),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90db37ff-95')
Oct 30 14:00:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Deleting instance files /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4_del
Oct 30 14:00:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Deletion of /opt/stack/data/nova/instances/1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4_del complete
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:11 user nova-compute[74319]: INFO nova.compute.manager [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 30 14:00:11 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:00:11 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:00:11 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:12 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Took 1.24 seconds to deallocate network for instance.
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] No waiting events found dispatching network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:12 user nova-compute[74319]: WARNING nova.compute.manager [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received unexpected event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 for instance with vm_state building and task_state spawning.
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-97e21927-fba7-4255-9114-5745d1abeae7 req-3b1be9b3-fb8e-46c6-af2e-157f00919e23 service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-deleted-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:12 user nova-compute[74319]: INFO nova.compute.manager [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Detaching volume 9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] Acquiring lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] No waiting events found dispatching network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:12 user nova-compute[74319]: WARNING nova.compute.manager [req-e1a49454-9285-489a-8b31-e2b08e8cc9dc req-9ede3684-6c37-4351-ac7c-7c51c92e087b service nova] [instance: 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4] Received unexpected event network-vif-plugged-90db37ff-95ac-4232-9116-f20a7ab74a27 for instance with vm_state deleted and task_state None.
Oct 30 14:00:12 user nova-compute[74319]: INFO nova.virt.block_device [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Attempting to driver detach volume 9f3043bf-dcde-462a-b1b2-d07fdad582e6 from mountpoint /dev/vdb
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:00:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Instance spawned successfully.
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Attempting to detach device vdb from instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:00:12 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:00:12 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:00:12 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:00:12 user nova-compute[74319]:   <serial>9f3043bf-dcde-462a-b1b2-d07fdad582e6</serial>
Oct 30 14:00:12 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:00:12 user nova-compute[74319]: </disk>
Oct 30 14:00:12 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b from the persistent domain config.
Oct 30 14:00:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:00:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:00:13 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:00:13 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:00:13 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:00:13 user nova-compute[74319]:   <serial>9f3043bf-dcde-462a-b1b2-d07fdad582e6</serial>
Oct 30 14:00:13 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:00:13 user nova-compute[74319]: </disk>
Oct 30 14:00:13 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:00:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:13 user nova-compute[74319]: INFO nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Took 7.39 seconds to spawn the instance on the hypervisor.
Oct 30 14:00:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:00:13 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Deleted allocations for instance 1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4
Oct 30 14:00:13 user nova-compute[74319]: INFO nova.compute.manager [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Took 8.32 seconds to build instance.
Oct 30 14:00:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd99d24d-e32f-4bef-8b20-11eb9b654c46 tempest-TestVolumeSwap-207996520 tempest-TestVolumeSwap-207996520-project-member] Lock "1d5ec4d1-e3bf-463f-b9cd-aa23b375c7f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.349s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea978938-2646-4de2-ae98-0250517083ca tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.477s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:00:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:00:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:22 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8107MB free_disk=25.683055877685547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 522d8b87-0d8c-42b5-9dfd-d64b8754d64d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:00:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:00:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:00:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:00:26 user nova-compute[74319]: INFO nova.compute.claims [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Claim successful on node user
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:00:26 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.policy [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd03a462b75b14b4fb30f66a3b0e051d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae8f2e2f199408596776c53c41a7986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:00:26 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Creating image(s)
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk 1073741824" returned: 0 in 0.053s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Successfully created port: ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Cannot resize image /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Ensure instance console log exists: /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Successfully updated port: ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing instance network info cache due to event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Instance network_info: |[{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Start _get_guest_xml network_info=[{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:00:28 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:28 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900057634',display_name='tempest-ServerActionsTestOtherA-server-1900057634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900057634',id=14,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-90wn82ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=fd2845ad-7fce-4307-b12e-d3b77fcaffa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'pci_devices' on Instance uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:00:28 user nova-compute[74319]:   <uuid>fd2845ad-7fce-4307-b12e-d3b77fcaffa7</uuid>
Oct 30 14:00:28 user nova-compute[74319]:   <name>instance-0000000e</name>
Oct 30 14:00:28 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:00:28 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:00:28 user nova-compute[74319]:   <metadata>
Oct 30 14:00:28 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:00:28 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:name>tempest-ServerActionsTestOtherA-server-1900057634</nova:name>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:00:28</nova:creationTime>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:00:28 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:00:28 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:owner>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:user uuid="d03a462b75b14b4fb30f66a3b0e051d4">tempest-ServerActionsTestOtherA-768990641-project-member</nova:user>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:project uuid="0ae8f2e2f199408596776c53c41a7986">tempest-ServerActionsTestOtherA-768990641</nova:project>
Oct 30 14:00:28 user nova-compute[74319]:       </nova:owner>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:00:28 user nova-compute[74319]:       <nova:ports>
Oct 30 14:00:28 user nova-compute[74319]:         <nova:port uuid="ad5624f5-c85a-4fe9-9388-c45039fd474c">
Oct 30 14:00:28 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:00:28 user nova-compute[74319]:         </nova:port>
Oct 30 14:00:28 user nova-compute[74319]:       </nova:ports>
Oct 30 14:00:28 user nova-compute[74319]:     </nova:instance>
Oct 30 14:00:28 user nova-compute[74319]:   </metadata>
Oct 30 14:00:28 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:00:28 user nova-compute[74319]:     <system>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="serial">fd2845ad-7fce-4307-b12e-d3b77fcaffa7</entry>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="uuid">fd2845ad-7fce-4307-b12e-d3b77fcaffa7</entry>
Oct 30 14:00:28 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:00:28 user nova-compute[74319]:     </system>
Oct 30 14:00:28 user nova-compute[74319]:   </sysinfo>
Oct 30 14:00:28 user nova-compute[74319]:   <os>
Oct 30 14:00:28 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:00:28 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:00:28 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:00:28 user nova-compute[74319]:   </os>
Oct 30 14:00:28 user nova-compute[74319]:   <features>
Oct 30 14:00:28 user nova-compute[74319]:     <acpi/>
Oct 30 14:00:28 user nova-compute[74319]:     <apic/>
Oct 30 14:00:28 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:00:28 user nova-compute[74319]:   </features>
Oct 30 14:00:28 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:00:28 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:00:28 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:00:28 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:00:28 user nova-compute[74319]:   </clock>
Oct 30 14:00:28 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:00:28 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:00:28 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:00:28 user nova-compute[74319]:   </cpu>
Oct 30 14:00:28 user nova-compute[74319]:   <devices>
Oct 30 14:00:28 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:00:28 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:00:28 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk"/>
Oct 30 14:00:28 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:00:28 user nova-compute[74319]:     </disk>
Oct 30 14:00:28 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:00:28 user nova-compute[74319]:       <mac address="fa:16:3e:2c:3b:a9"/>
Oct 30 14:00:28 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:28 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:00:28 user nova-compute[74319]:       <target dev="tapad5624f5-c8"/>
Oct 30 14:00:28 user nova-compute[74319]:     </interface>
Oct 30 14:00:28 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:00:28 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/console.log" append="off"/>
Oct 30 14:00:28 user nova-compute[74319]:     </serial>
Oct 30 14:00:28 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:00:28 user nova-compute[74319]:     <video>
Oct 30 14:00:28 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:28 user nova-compute[74319]:     </video>
Oct 30 14:00:28 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:00:28 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:00:28 user nova-compute[74319]:     </rng>
Oct 30 14:00:28 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:00:28 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:00:28 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:00:28 user nova-compute[74319]:     </memballoon>
Oct 30 14:00:28 user nova-compute[74319]:   </devices>
Oct 30 14:00:28 user nova-compute[74319]: </domain>
Oct 30 14:00:28 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900057634',display_name='tempest-ServerActionsTestOtherA-server-1900057634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900057634',id=14,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-90wn82ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=fd2845ad-7fce-4307-b12e-d3b77fcaffa7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG os_vif [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f8f7efd-4841-5251-9c15-f73a8c0338a0', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad5624f5-c8, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad5624f5-c8, col_values=(('qos', UUID('303a233e-842a-4ead-9c81-bb46170369ef')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad5624f5-c8, col_values=(('external_ids', {'iface-id': 'ad5624f5-c85a-4fe9-9388-c45039fd474c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:3b:a9', 'vm-uuid': 'fd2845ad-7fce-4307-b12e-d3b77fcaffa7'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:28 user nova-compute[74319]: INFO os_vif [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8')
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:00:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:2c:3b:a9, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:00:29 user nova-compute[74319]: DEBUG nova.network.neutron [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated VIF entry in instance network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:00:29 user nova-compute[74319]: DEBUG nova.network.neutron [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b689aeeb-7c18-4f4c-b730-82f1c00f0782 req-99929ea6-bc4b-4242-99c9-739e179f5cff service nova] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] No waiting events found dispatching network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:30 user nova-compute[74319]: WARNING nova.compute.manager [req-4d33dc21-3c12-4b70-a14f-543fb3bcb3c4 req-94af94ee-903c-48f0-b9cf-82ce196acfe6 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received unexpected event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c for instance with vm_state building and task_state spawning.
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:00:30 user nova-compute[74319]: WARNING nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid bb5d67f1-e3ef-41ae-94f1-29c29eb30388 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 67280b94-8d8c-47ce-800d-a88d7de8e3d3 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 522d8b87-0d8c-42b5-9dfd-d64b8754d64d {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: INFO nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Oct 30 14:00:30 user nova-compute[74319]: WARNING nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance is unexpectedly not found. Ignore.
Oct 30 14:00:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.198s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] No waiting events found dispatching network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:00:32 user nova-compute[74319]: WARNING nova.compute.manager [req-e95c5dfd-e23b-47d3-94b6-324054a92f55 req-68388561-cac9-4cd3-ba48-a745864e87a0 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received unexpected event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c for instance with vm_state building and task_state spawning.
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:00:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Instance spawned successfully.
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:00:32 user nova-compute[74319]: INFO nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Took 5.84 seconds to spawn the instance on the hypervisor.
Oct 30 14:00:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:00:32 user nova-compute[74319]: INFO nova.compute.manager [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Took 6.58 seconds to build instance.
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1cde3648-7b5b-443b-b82f-a835bc1fc728 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.684s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.111s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:32 user nova-compute[74319]: INFO nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 30 14:00:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b is timed out.
Oct 30 14:00:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b from the live domain config.
Oct 30 14:00:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tOAUpsji', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:00:33 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[106290d0-aa66-4c18-b015-9fd2d90afed7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:00:33 user nova-compute[74319]: No targets found.
Oct 30 14:00:33 user nova-compute[74319]: iSNS:
Oct 30 14:00:33 user nova-compute[74319]: No targets found.
Oct 30 14:00:33 user nova-compute[74319]: STATIC:
Oct 30 14:00:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6
Oct 30 14:00:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:00:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:00:33 user nova-compute[74319]: FIRMWARE:
Oct 30 14:00:33 user nova-compute[74319]: No targets found.
Oct 30 14:00:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:00:33 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:00:33 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5bc23-3907-416a-a11d-cfe55f4f352b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d116154-e02d-44f7-b22d-1724a9a76707]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 14:00:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 (non-flash)
Oct 30 14:00:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9985c04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd72168-58a4-4f8d-aaa1-9f3251bf3a96]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d693b8-532b-4598-ae69-6059911af890]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c152cc2-b7ce-4c4f-893e-bc6d62558d55]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20b7f87-011b-492c-9c02-5890b14df70c]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7012f0-d917-41e0-ad0c-e679293686c2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1a3c91-54c4-4000-b2ce-1e0772e42b4e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260]
Oct 30 14:00:33 user nova-compute[74319]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6, portal: 172.16.0.220,3260] successful.
Oct 30 14:00:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f3043bf-dcde-462a-b1b2-d07fdad582e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9c174a-3de2-49cd-8be5-e6cd7779ff76]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== disconnect_volume: return (356ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:00:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:00:34 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:00:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8a5bfa30-1c99-43fc-a7bb-34267db891ef tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.167s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.356s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:00:55 user nova-compute[74319]: INFO nova.compute.claims [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Claim successful on node user
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:00:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.579s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:00:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.policy [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a708010243464fe9bbf96c2e0e79a0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f2668e6b874840ad286ca9a8189fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:00:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Creating image(s)
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk 1073741824" returned: 0 in 0.058s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Successfully created port: e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Cannot resize image /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Ensure instance console log exists: /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Successfully updated port: e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-changed-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Refreshing instance network info cache due to event network-changed-e2267563-7015-4437-b8dd-eea233e1f0a1. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:00:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Instance network_info: |[{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Refreshing network info cache for port e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Start _get_guest_xml network_info=[{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:00:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483966066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483966066',id=15,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-mhtlp2be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:56Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=7ce4683d-18d7-47cb-9f2e-15a53c528d82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce4683d-18d7-47cb-9f2e-15a53c528d82 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:00:58 user nova-compute[74319]:   <uuid>7ce4683d-18d7-47cb-9f2e-15a53c528d82</uuid>
Oct 30 14:00:58 user nova-compute[74319]:   <name>instance-0000000f</name>
Oct 30 14:00:58 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:00:58 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:00:58 user nova-compute[74319]:   <metadata>
Oct 30 14:00:58 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:00:58 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1483966066</nova:name>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:00:58</nova:creationTime>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:00:58 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:00:58 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:owner>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:00:58 user nova-compute[74319]:       </nova:owner>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:00:58 user nova-compute[74319]:       <nova:ports>
Oct 30 14:00:58 user nova-compute[74319]:         <nova:port uuid="e2267563-7015-4437-b8dd-eea233e1f0a1">
Oct 30 14:00:58 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 14:00:58 user nova-compute[74319]:         </nova:port>
Oct 30 14:00:58 user nova-compute[74319]:       </nova:ports>
Oct 30 14:00:58 user nova-compute[74319]:     </nova:instance>
Oct 30 14:00:58 user nova-compute[74319]:   </metadata>
Oct 30 14:00:58 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:00:58 user nova-compute[74319]:     <system>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="serial">7ce4683d-18d7-47cb-9f2e-15a53c528d82</entry>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="uuid">7ce4683d-18d7-47cb-9f2e-15a53c528d82</entry>
Oct 30 14:00:58 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:00:58 user nova-compute[74319]:     </system>
Oct 30 14:00:58 user nova-compute[74319]:   </sysinfo>
Oct 30 14:00:58 user nova-compute[74319]:   <os>
Oct 30 14:00:58 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:00:58 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:00:58 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:00:58 user nova-compute[74319]:   </os>
Oct 30 14:00:58 user nova-compute[74319]:   <features>
Oct 30 14:00:58 user nova-compute[74319]:     <acpi/>
Oct 30 14:00:58 user nova-compute[74319]:     <apic/>
Oct 30 14:00:58 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:00:58 user nova-compute[74319]:   </features>
Oct 30 14:00:58 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:00:58 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:00:58 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:00:58 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:00:58 user nova-compute[74319]:   </clock>
Oct 30 14:00:58 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:00:58 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:00:58 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:00:58 user nova-compute[74319]:   </cpu>
Oct 30 14:00:58 user nova-compute[74319]:   <devices>
Oct 30 14:00:58 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:00:58 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:00:58 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk"/>
Oct 30 14:00:58 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:00:58 user nova-compute[74319]:     </disk>
Oct 30 14:00:58 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:00:58 user nova-compute[74319]:       <mac address="fa:16:3e:b6:64:0d"/>
Oct 30 14:00:58 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:58 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:00:58 user nova-compute[74319]:       <target dev="tape2267563-70"/>
Oct 30 14:00:58 user nova-compute[74319]:     </interface>
Oct 30 14:00:58 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:00:58 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/console.log" append="off"/>
Oct 30 14:00:58 user nova-compute[74319]:     </serial>
Oct 30 14:00:58 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:00:58 user nova-compute[74319]:     <video>
Oct 30 14:00:58 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:00:58 user nova-compute[74319]:     </video>
Oct 30 14:00:58 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:00:58 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:00:58 user nova-compute[74319]:     </rng>
Oct 30 14:00:58 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:00:58 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:00:58 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:00:58 user nova-compute[74319]:     </memballoon>
Oct 30 14:00:58 user nova-compute[74319]:   </devices>
Oct 30 14:00:58 user nova-compute[74319]: </domain>
Oct 30 14:00:58 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483966066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483966066',id=15,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-mhtlp2be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:00:56Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=7ce4683d-18d7-47cb-9f2e-15a53c528d82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG os_vif [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2cd1e7fb-6913-5d7d-b5fa-06d3003bffd0', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2267563-70, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2267563-70, col_values=(('qos', UUID('8b9ff2ee-333f-4312-98c0-bbc74b409ce4')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2267563-70, col_values=(('external_ids', {'iface-id': 'e2267563-7015-4437-b8dd-eea233e1f0a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:64:0d', 'vm-uuid': '7ce4683d-18d7-47cb-9f2e-15a53c528d82'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:58 user nova-compute[74319]: INFO os_vif [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70')
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:b6:64:0d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updated VIF entry in instance network info cache for port e2267563-7015-4437-b8dd-eea233e1f0a1. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:00:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6414214e-0ddc-41b1-94e3-b8bcd3bbe270 req-b47eeb7c-a575-4f93-aa66-2437ab3f3d6d service nova] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:00:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:00:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] No waiting events found dispatching network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:00 user nova-compute[74319]: WARNING nova.compute.manager [req-8a4d2040-94db-4c8f-94ab-7d962a90096b req-ecd10020-e11b-49d3-ac4e-6b974bb5c813 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received unexpected event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 for instance with vm_state building and task_state spawning.
Oct 30 14:01:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] No waiting events found dispatching network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:02 user nova-compute[74319]: WARNING nova.compute.manager [req-f3d6ccf0-c394-46d0-9cc2-6cdbca19ca95 req-913c32c5-7380-4b50-bcdd-906ab862bd12 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received unexpected event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 for instance with vm_state building and task_state spawning.
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:01:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Instance spawned successfully.
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:02 user nova-compute[74319]: INFO nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Took 5.82 seconds to spawn the instance on the hypervisor.
Oct 30 14:01:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:01:02 user nova-compute[74319]: INFO nova.compute.manager [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Took 6.94 seconds to build instance.
Oct 30 14:01:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fe4bf84b-362d-47f8-b6e3-457ca74f88b7 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.042s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:03 user nova-compute[74319]: INFO nova.compute.manager [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Terminating instance
Oct 30 14:01:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-unplugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] No waiting events found dispatching network-vif-unplugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-4f569f03-361a-44f8-9ca5-54aeadb6fbf8 req-0442b88b-3eda-42a2-aa0f-2e72b9059eb6 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-unplugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:01:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Instance destroyed successfully.
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.objects.instance [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'resources' on Instance uuid 4b25c9fe-a007-432e-b3a0-9b0df509b33b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-135573517',display_name='tempest-AttachVolumeNegativeTest-server-135573517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-135573517',id=1,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIsYKJlH54QpTcOGIS93Qht181N+yaK1+aS/FMt+hxcBk7r+YY567Iv1V+n9K4dzT7cLwfXOpFTn4ZAMYUHVhFr1kt+EajOkO3tBjqqtWwMKkPLJalkveYA6po9TVE4Ag==',key_name='tempest-keypair-1652306217',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-pqxuo1qc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=4b25c9fe-a007-432e-b3a0-9b0df509b33b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "address": "fa:16:3e:df:ad:0d", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21dcf81b-73", "ovs_interfaceid": "21dcf81b-73bc-43c1-a5b4-e93c62d76925", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG os_vif [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21dcf81b-73, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df898359-b685-4e81-b6bd-83be6d82ccf4) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:04 user nova-compute[74319]: INFO os_vif [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:ad:0d,bridge_name='br-int',has_traffic_filtering=True,id=21dcf81b-73bc-43c1-a5b4-e93c62d76925,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21dcf81b-73')
Oct 30 14:01:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Deleting instance files /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b_del
Oct 30 14:01:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Deletion of /opt/stack/data/nova/instances/4b25c9fe-a007-432e-b3a0-9b0df509b33b_del complete
Oct 30 14:01:04 user nova-compute[74319]: INFO nova.compute.manager [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 30 14:01:04 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:01:04 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:05 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Took 1.06 seconds to deallocate network for instance.
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1200245-74b9-45d7-b2ff-c8560b99298f req-56c8a7f9-59af-47e7-8872-43b18849d51e service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-deleted-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] Acquiring lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] No waiting events found dispatching network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:05 user nova-compute[74319]: WARNING nova.compute.manager [req-64225a37-ee62-4bb8-9ab5-ce8240a18d1b req-86ca005a-d2a0-41cd-9684-83d3d7109f87 service nova] [instance: 4b25c9fe-a007-432e-b3a0-9b0df509b33b] Received unexpected event network-vif-plugged-21dcf81b-73bc-43c1-a5b4-e93c62d76925 for instance with vm_state deleted and task_state None.
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:05 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Deleted allocations for instance 4b25c9fe-a007-432e-b3a0-9b0df509b33b
Oct 30 14:01:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25d52dff-35d2-4162-b41d-031f6bc5dc7a tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "4b25c9fe-a007-432e-b3a0-9b0df509b33b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:17 user nova-compute[74319]: INFO nova.compute.manager [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Terminating instance
Oct 30 14:01:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-unplugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] No waiting events found dispatching network-vif-unplugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-242a81d8-c3ec-4a1e-bdb5-9a9228617dd0 req-f5779250-d502-418c-9f7b-ac9c06cbcf94 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-unplugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Instance destroyed successfully.
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'resources' on Instance uuid 522d8b87-0d8c-42b5-9dfd-d64b8754d64d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:59:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-10879322',display_name='tempest-VolumesAdminNegativeTest-server-10879322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-10879322',id=12,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-4o7ppz0s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:59:17Z,user_data=None,user_id='6515419e258d4c978180f0a2fec90ecc',uuid=522d8b87-0d8c-42b5-9dfd-d64b8754d64d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "address": "fa:16:3e:6d:79:8b", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb02a63c2-2c", "ovs_interfaceid": "b02a63c2-2cab-459c-8dbf-63bcb9337415", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG os_vif [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb02a63c2-2c, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be09d810-f7b6-4f0c-94fa-71fc015f2a1e) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:18 user nova-compute[74319]: INFO os_vif [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:79:8b,bridge_name='br-int',has_traffic_filtering=True,id=b02a63c2-2cab-459c-8dbf-63bcb9337415,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb02a63c2-2c')
Oct 30 14:01:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Deleting instance files /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d_del
Oct 30 14:01:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Deletion of /opt/stack/data/nova/instances/522d8b87-0d8c-42b5-9dfd-d64b8754d64d_del complete
Oct 30 14:01:18 user nova-compute[74319]: INFO nova.compute.manager [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 30 14:01:18 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:01:18 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:18 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Took 0.58 seconds to deallocate network for instance.
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:19 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Deleted allocations for instance 522d8b87-0d8c-42b5-9dfd-d64b8754d64d
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b6d82797-61cb-4c95-9add-b99c3936ae2f tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] Acquiring lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] Lock "522d8b87-0d8c-42b5-9dfd-d64b8754d64d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] No waiting events found dispatching network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:19 user nova-compute[74319]: WARNING nova.compute.manager [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received unexpected event network-vif-plugged-b02a63c2-2cab-459c-8dbf-63bcb9337415 for instance with vm_state deleted and task_state None.
Oct 30 14:01:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e3120da0-0aec-43c0-8e76-91a4fc32f70a req-1a1b9d5d-9f8f-4d7a-bbc8-734a732f8229 service nova] [instance: 522d8b87-0d8c-42b5-9dfd-d64b8754d64d] Received event network-vif-deleted-b02a63c2-2cab-459c-8dbf-63bcb9337415 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:21 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:24 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:24 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8029MB free_disk=25.64069366455078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:01:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:01:25 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:25 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:25 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:01:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.374s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:01:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid bb5d67f1-e3ef-41ae-94f1-29c29eb30388 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [{"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-bb5d67f1-e3ef-41ae-94f1-29c29eb30388" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:01:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:01:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:01:48 user nova-compute[74319]: INFO nova.compute.claims [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Claim successful on node user
Oct 30 14:01:48 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:01:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.policy [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c78dc89d1754b9bbf4c7765ae964424', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8bd07cd0f84c1a9d10b5cb28c3f617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:01:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Creating image(s)
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "/opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "/opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "/opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.054s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.202s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk 1073741824" returned: 0 in 0.055s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Successfully created port: 00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:01:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Cannot resize image /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Ensure instance console log exists: /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Successfully updated port: 00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquired lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-changed-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Refreshing instance network info cache due to event network-changed-00680d07-135d-4d2d-aba4-96603ad216b8. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] Acquiring lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updating instance_info_cache with network_info: [{"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Releasing lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Instance network_info: |[{"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] Acquired lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Refreshing network info cache for port 00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Start _get_guest_xml network_info=[{"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:01:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1127611427',display_name='tempest-DeleteServersTestJSON-server-1127611427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1127611427',id=16,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8bd07cd0f84c1a9d10b5cb28c3f617',ramdisk_id='',reservation_id='r-3w65nqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2102119684',owner_user_name='tempest-DeleteServersTestJSON-2102119684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:49Z,user_data=None,user_id='8c78dc89d1754b9bbf4c7765ae964424',uuid=40d154bd-570e-47ee-be88-9e6cfa3463fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converting VIF {"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lazy-loading 'pci_devices' on Instance uuid 40d154bd-570e-47ee-be88-9e6cfa3463fe {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:01:50 user nova-compute[74319]:   <uuid>40d154bd-570e-47ee-be88-9e6cfa3463fe</uuid>
Oct 30 14:01:50 user nova-compute[74319]:   <name>instance-00000010</name>
Oct 30 14:01:50 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:01:50 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:01:50 user nova-compute[74319]:   <metadata>
Oct 30 14:01:50 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:01:50 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:name>tempest-DeleteServersTestJSON-server-1127611427</nova:name>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:01:50</nova:creationTime>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:01:50 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:01:50 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:owner>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:user uuid="8c78dc89d1754b9bbf4c7765ae964424">tempest-DeleteServersTestJSON-2102119684-project-member</nova:user>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:project uuid="8d8bd07cd0f84c1a9d10b5cb28c3f617">tempest-DeleteServersTestJSON-2102119684</nova:project>
Oct 30 14:01:50 user nova-compute[74319]:       </nova:owner>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:01:50 user nova-compute[74319]:       <nova:ports>
Oct 30 14:01:50 user nova-compute[74319]:         <nova:port uuid="00680d07-135d-4d2d-aba4-96603ad216b8">
Oct 30 14:01:50 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:01:50 user nova-compute[74319]:         </nova:port>
Oct 30 14:01:50 user nova-compute[74319]:       </nova:ports>
Oct 30 14:01:50 user nova-compute[74319]:     </nova:instance>
Oct 30 14:01:50 user nova-compute[74319]:   </metadata>
Oct 30 14:01:50 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:01:50 user nova-compute[74319]:     <system>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="serial">40d154bd-570e-47ee-be88-9e6cfa3463fe</entry>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="uuid">40d154bd-570e-47ee-be88-9e6cfa3463fe</entry>
Oct 30 14:01:50 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:01:50 user nova-compute[74319]:     </system>
Oct 30 14:01:50 user nova-compute[74319]:   </sysinfo>
Oct 30 14:01:50 user nova-compute[74319]:   <os>
Oct 30 14:01:50 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:01:50 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:01:50 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:01:50 user nova-compute[74319]:   </os>
Oct 30 14:01:50 user nova-compute[74319]:   <features>
Oct 30 14:01:50 user nova-compute[74319]:     <acpi/>
Oct 30 14:01:50 user nova-compute[74319]:     <apic/>
Oct 30 14:01:50 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:01:50 user nova-compute[74319]:   </features>
Oct 30 14:01:50 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:01:50 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:01:50 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:01:50 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:01:50 user nova-compute[74319]:   </clock>
Oct 30 14:01:50 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:01:50 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:01:50 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:01:50 user nova-compute[74319]:   </cpu>
Oct 30 14:01:50 user nova-compute[74319]:   <devices>
Oct 30 14:01:50 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:01:50 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:01:50 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk"/>
Oct 30 14:01:50 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:01:50 user nova-compute[74319]:     </disk>
Oct 30 14:01:50 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:01:50 user nova-compute[74319]:       <mac address="fa:16:3e:59:b0:b1"/>
Oct 30 14:01:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:01:50 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:01:50 user nova-compute[74319]:       <target dev="tap00680d07-13"/>
Oct 30 14:01:50 user nova-compute[74319]:     </interface>
Oct 30 14:01:50 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:01:50 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/console.log" append="off"/>
Oct 30 14:01:50 user nova-compute[74319]:     </serial>
Oct 30 14:01:50 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:01:50 user nova-compute[74319]:     <video>
Oct 30 14:01:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:01:50 user nova-compute[74319]:     </video>
Oct 30 14:01:50 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:01:50 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:01:50 user nova-compute[74319]:     </rng>
Oct 30 14:01:50 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:01:50 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:01:50 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:01:50 user nova-compute[74319]:     </memballoon>
Oct 30 14:01:50 user nova-compute[74319]:   </devices>
Oct 30 14:01:50 user nova-compute[74319]: </domain>
Oct 30 14:01:50 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1127611427',display_name='tempest-DeleteServersTestJSON-server-1127611427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1127611427',id=16,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d8bd07cd0f84c1a9d10b5cb28c3f617',ramdisk_id='',reservation_id='r-3w65nqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2102119684',owner_user_name='tempest-DeleteServersTestJSON-2102119684-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:49Z,user_data=None,user_id='8c78dc89d1754b9bbf4c7765ae964424',uuid=40d154bd-570e-47ee-be88-9e6cfa3463fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converting VIF {"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG os_vif [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb846f45-e9cf-57a5-9dd6-616d9ea007d6', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap00680d07-13, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap00680d07-13, col_values=(('qos', UUID('2823717c-302f-40e5-a817-6ae19673a71b')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap00680d07-13, col_values=(('external_ids', {'iface-id': '00680d07-135d-4d2d-aba4-96603ad216b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:b0:b1', 'vm-uuid': '40d154bd-570e-47ee-be88-9e6cfa3463fe'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:50 user nova-compute[74319]: INFO os_vif [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13')
Oct 30 14:01:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:01:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] No VIF found with MAC fa:16:3e:59:b0:b1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:01:51 user nova-compute[74319]: DEBUG nova.network.neutron [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updated VIF entry in instance network info cache for port 00680d07-135d-4d2d-aba4-96603ad216b8. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:01:51 user nova-compute[74319]: DEBUG nova.network.neutron [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updating instance_info_cache with network_info: [{"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2e67d00d-8ebd-498f-bea1-f7bb213eec0a req-970cd5d2-8c83-46d2-8e9e-ffac07a1b244 service nova] Releasing lock "refresh_cache-40d154bd-570e-47ee-be88-9e6cfa3463fe" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] No waiting events found dispatching network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:52 user nova-compute[74319]: WARNING nova.compute.manager [req-af105e57-0c12-4fe3-82b5-82aa2cfccbe1 req-458ca269-bcb2-4ac2-8a0f-8d610425079c service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received unexpected event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 for instance with vm_state building and task_state spawning.
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] No waiting events found dispatching network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:01:54 user nova-compute[74319]: WARNING nova.compute.manager [req-2ca058ae-46f2-445c-beef-341b0f400736 req-3d48271c-af93-4cdc-87c0-beab24a30c8d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received unexpected event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 for instance with vm_state building and task_state spawning.
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:01:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Instance spawned successfully.
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:01:54 user nova-compute[74319]: INFO nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Took 5.58 seconds to spawn the instance on the hypervisor.
Oct 30 14:01:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:01:54 user nova-compute[74319]: INFO nova.compute.manager [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Took 6.35 seconds to build instance.
Oct 30 14:01:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8acf13dd-2b49-46f0-a70d-4635018b2baf tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.466s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:01:55 user nova-compute[74319]: INFO nova.compute.claims [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Claim successful on node user
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:01:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.policy [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24eece1d8fbe4be482f6afc140f0b2fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea0328481b34a30ab78698c9815c6f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:01:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Creating image(s)
Oct 30 14:01:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "/opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "/opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.215s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk 1073741824" returned: 0 in 0.056s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.236s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Successfully created port: 29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Cannot resize image /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Ensure instance console log exists: /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:01:58 user nova-compute[74319]: INFO nova.compute.claims [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Claim successful on node user
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Successfully updated port: 29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquired lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-changed-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Refreshing instance network info cache due to event network-changed-29db6805-71ea-4c40-9869-7ed058ea5d33. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] Acquiring lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Updating instance_info_cache with network_info: [{"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Releasing lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Instance network_info: |[{"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] Acquired lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Refreshing network info cache for port 29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Start _get_guest_xml network_info=[{"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:01:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:01:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-200165636',display_name='tempest-ServersNegativeTestJSON-server-200165636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-200165636',id=17,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-ie5h8j4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:57Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=7ebc3e67-eb79-4e83-94d1-ce44281f7007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ebc3e67-eb79-4e83-94d1-ce44281f7007 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:01:59 user nova-compute[74319]:   <uuid>7ebc3e67-eb79-4e83-94d1-ce44281f7007</uuid>
Oct 30 14:01:59 user nova-compute[74319]:   <name>instance-00000011</name>
Oct 30 14:01:59 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:01:59 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:01:59 user nova-compute[74319]:   <metadata>
Oct 30 14:01:59 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:01:59 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:name>tempest-ServersNegativeTestJSON-server-200165636</nova:name>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:01:58</nova:creationTime>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:01:59 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:01:59 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:owner>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:user uuid="24eece1d8fbe4be482f6afc140f0b2fa">tempest-ServersNegativeTestJSON-1299330642-project-member</nova:user>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:project uuid="fea0328481b34a30ab78698c9815c6f5">tempest-ServersNegativeTestJSON-1299330642</nova:project>
Oct 30 14:01:59 user nova-compute[74319]:       </nova:owner>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:01:59 user nova-compute[74319]:       <nova:ports>
Oct 30 14:01:59 user nova-compute[74319]:         <nova:port uuid="29db6805-71ea-4c40-9869-7ed058ea5d33">
Oct 30 14:01:59 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:01:59 user nova-compute[74319]:         </nova:port>
Oct 30 14:01:59 user nova-compute[74319]:       </nova:ports>
Oct 30 14:01:59 user nova-compute[74319]:     </nova:instance>
Oct 30 14:01:59 user nova-compute[74319]:   </metadata>
Oct 30 14:01:59 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:01:59 user nova-compute[74319]:     <system>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="serial">7ebc3e67-eb79-4e83-94d1-ce44281f7007</entry>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="uuid">7ebc3e67-eb79-4e83-94d1-ce44281f7007</entry>
Oct 30 14:01:59 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:01:59 user nova-compute[74319]:     </system>
Oct 30 14:01:59 user nova-compute[74319]:   </sysinfo>
Oct 30 14:01:59 user nova-compute[74319]:   <os>
Oct 30 14:01:59 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:01:59 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:01:59 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:01:59 user nova-compute[74319]:   </os>
Oct 30 14:01:59 user nova-compute[74319]:   <features>
Oct 30 14:01:59 user nova-compute[74319]:     <acpi/>
Oct 30 14:01:59 user nova-compute[74319]:     <apic/>
Oct 30 14:01:59 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:01:59 user nova-compute[74319]:   </features>
Oct 30 14:01:59 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:01:59 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:01:59 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:01:59 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:01:59 user nova-compute[74319]:   </clock>
Oct 30 14:01:59 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:01:59 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:01:59 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:01:59 user nova-compute[74319]:   </cpu>
Oct 30 14:01:59 user nova-compute[74319]:   <devices>
Oct 30 14:01:59 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:01:59 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:01:59 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk"/>
Oct 30 14:01:59 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:01:59 user nova-compute[74319]:     </disk>
Oct 30 14:01:59 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:01:59 user nova-compute[74319]:       <mac address="fa:16:3e:2f:0c:59"/>
Oct 30 14:01:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:01:59 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:01:59 user nova-compute[74319]:       <target dev="tap29db6805-71"/>
Oct 30 14:01:59 user nova-compute[74319]:     </interface>
Oct 30 14:01:59 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:01:59 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/console.log" append="off"/>
Oct 30 14:01:59 user nova-compute[74319]:     </serial>
Oct 30 14:01:59 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:01:59 user nova-compute[74319]:     <video>
Oct 30 14:01:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:01:59 user nova-compute[74319]:     </video>
Oct 30 14:01:59 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:01:59 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:01:59 user nova-compute[74319]:     </rng>
Oct 30 14:01:59 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:01:59 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:01:59 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:01:59 user nova-compute[74319]:     </memballoon>
Oct 30 14:01:59 user nova-compute[74319]:   </devices>
Oct 30 14:01:59 user nova-compute[74319]: </domain>
Oct 30 14:01:59 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-200165636',display_name='tempest-ServersNegativeTestJSON-server-200165636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-200165636',id=17,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-ie5h8j4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:57Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=7ebc3e67-eb79-4e83-94d1-ce44281f7007,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG os_vif [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '665dc8b2-0448-518b-bb75-a0beeb9e8b4a', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29db6805-71, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29db6805-71, col_values=(('qos', UUID('5b698cd8-e52c-4644-b1b7-d71d637eed75')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29db6805-71, col_values=(('external_ids', {'iface-id': '29db6805-71ea-4c40-9869-7ed058ea5d33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:0c:59', 'vm-uuid': '7ebc3e67-eb79-4e83-94d1-ce44281f7007'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:01:59 user nova-compute[74319]: INFO os_vif [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71')
Oct 30 14:01:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] No VIF found with MAC fa:16:3e:2f:0c:59, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.policy [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f860f101c5034c638821e668d33eeeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6fce9483d048b580da3d18df44316d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:01:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Creating image(s)
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "/opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.230s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk 1073741824" returned: 0 in 0.055s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.neutron [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Updated VIF entry in instance network info cache for port 29db6805-71ea-4c40-9869-7ed058ea5d33. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG nova.network.neutron [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Updating instance_info_cache with network_info: [{"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:01:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-75d598ec-4b34-44ed-b676-f9ff37da96f3 req-7acb978e-97b6-470a-9b77-1ae4816ed77a service nova] Releasing lock "refresh_cache-7ebc3e67-eb79-4e83-94d1-ce44281f7007" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.236s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Cannot resize image /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Ensure instance console log exists: /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Successfully created port: 7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] No waiting events found dispatching network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:00 user nova-compute[74319]: WARNING nova.compute.manager [req-b9b5f8b9-8ec4-4f07-a259-758f3df1e7db req-1068d3d7-65a7-491f-a403-0d17644bed90 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received unexpected event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 for instance with vm_state building and task_state spawning.
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Successfully updated port: 7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquired lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-changed-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Refreshing instance network info cache due to event network-changed-7be24740-a682-4688-9c44-14ae3b084a09. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] Acquiring lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updating instance_info_cache with network_info: [{"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Releasing lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Instance network_info: |[{"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] Acquired lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Refreshing network info cache for port 7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Start _get_guest_xml network_info=[{"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:02:01 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:02:01 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-682710485',display_name='tempest-AttachVolumeNegativeTest-server-682710485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-682710485',id=18,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrOcWxRvGT/cdzYbECQWaaFbbxbE7DoXt8fZSBaJuxX1Y67fDztIeFxFcZzBBpnsV9FYjMfzg6vkW/AmHdclNzWhEWMuNMPQP19S2dEzGsdIcvdy2Vky3MtWMILEblEsQ==',key_name='tempest-keypair-105813618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-krhwzx3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=2737c88d-9a65-49c1-9ba6-988e3434b99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'pci_devices' on Instance uuid 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:02:01 user nova-compute[74319]:   <uuid>2737c88d-9a65-49c1-9ba6-988e3434b99d</uuid>
Oct 30 14:02:01 user nova-compute[74319]:   <name>instance-00000012</name>
Oct 30 14:02:01 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:02:01 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:02:01 user nova-compute[74319]:   <metadata>
Oct 30 14:02:01 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:02:01 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-682710485</nova:name>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:02:01</nova:creationTime>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:02:01 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:02:01 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:owner>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:user uuid="f860f101c5034c638821e668d33eeeff">tempest-AttachVolumeNegativeTest-1763755820-project-member</nova:user>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:project uuid="ee6fce9483d048b580da3d18df44316d">tempest-AttachVolumeNegativeTest-1763755820</nova:project>
Oct 30 14:02:01 user nova-compute[74319]:       </nova:owner>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:02:01 user nova-compute[74319]:       <nova:ports>
Oct 30 14:02:01 user nova-compute[74319]:         <nova:port uuid="7be24740-a682-4688-9c44-14ae3b084a09">
Oct 30 14:02:01 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:02:01 user nova-compute[74319]:         </nova:port>
Oct 30 14:02:01 user nova-compute[74319]:       </nova:ports>
Oct 30 14:02:01 user nova-compute[74319]:     </nova:instance>
Oct 30 14:02:01 user nova-compute[74319]:   </metadata>
Oct 30 14:02:01 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:02:01 user nova-compute[74319]:     <system>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="serial">2737c88d-9a65-49c1-9ba6-988e3434b99d</entry>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="uuid">2737c88d-9a65-49c1-9ba6-988e3434b99d</entry>
Oct 30 14:02:01 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:02:01 user nova-compute[74319]:     </system>
Oct 30 14:02:01 user nova-compute[74319]:   </sysinfo>
Oct 30 14:02:01 user nova-compute[74319]:   <os>
Oct 30 14:02:01 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:02:01 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:02:01 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:02:01 user nova-compute[74319]:   </os>
Oct 30 14:02:01 user nova-compute[74319]:   <features>
Oct 30 14:02:01 user nova-compute[74319]:     <acpi/>
Oct 30 14:02:01 user nova-compute[74319]:     <apic/>
Oct 30 14:02:01 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:02:01 user nova-compute[74319]:   </features>
Oct 30 14:02:01 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:02:01 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:02:01 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:02:01 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:02:01 user nova-compute[74319]:   </clock>
Oct 30 14:02:01 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:02:01 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:02:01 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:02:01 user nova-compute[74319]:   </cpu>
Oct 30 14:02:01 user nova-compute[74319]:   <devices>
Oct 30 14:02:01 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:02:01 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:02:01 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk"/>
Oct 30 14:02:01 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:02:01 user nova-compute[74319]:     </disk>
Oct 30 14:02:01 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:02:01 user nova-compute[74319]:       <mac address="fa:16:3e:b6:3c:8f"/>
Oct 30 14:02:01 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:02:01 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:02:01 user nova-compute[74319]:       <target dev="tap7be24740-a6"/>
Oct 30 14:02:01 user nova-compute[74319]:     </interface>
Oct 30 14:02:01 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:02:01 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/console.log" append="off"/>
Oct 30 14:02:01 user nova-compute[74319]:     </serial>
Oct 30 14:02:01 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:02:01 user nova-compute[74319]:     <video>
Oct 30 14:02:01 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:02:01 user nova-compute[74319]:     </video>
Oct 30 14:02:01 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:02:01 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:02:01 user nova-compute[74319]:     </rng>
Oct 30 14:02:01 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:02:01 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:02:01 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:02:01 user nova-compute[74319]:     </memballoon>
Oct 30 14:02:01 user nova-compute[74319]:   </devices>
Oct 30 14:02:01 user nova-compute[74319]: </domain>
Oct 30 14:02:01 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-682710485',display_name='tempest-AttachVolumeNegativeTest-server-682710485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-682710485',id=18,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrOcWxRvGT/cdzYbECQWaaFbbxbE7DoXt8fZSBaJuxX1Y67fDztIeFxFcZzBBpnsV9FYjMfzg6vkW/AmHdclNzWhEWMuNMPQP19S2dEzGsdIcvdy2Vky3MtWMILEblEsQ==',key_name='tempest-keypair-105813618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-krhwzx3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=2737c88d-9a65-49c1-9ba6-988e3434b99d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG os_vif [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '069c4a86-bdb1-500b-93ea-64ea1b8b09b4', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be24740-a6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7be24740-a6, col_values=(('qos', UUID('9c8e517e-8fec-4b40-89eb-d4313ff26177')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7be24740-a6, col_values=(('external_ids', {'iface-id': '7be24740-a682-4688-9c44-14ae3b084a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:3c:8f', 'vm-uuid': '2737c88d-9a65-49c1-9ba6-988e3434b99d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:01 user nova-compute[74319]: INFO os_vif [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6')
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:b6:3c:8f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updated VIF entry in instance network info cache for port 7be24740-a682-4688-9c44-14ae3b084a09. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updating instance_info_cache with network_info: [{"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88c6f63a-bf3b-46f2-9840-3d73407be389 req-81fa6dac-9250-4cc0-b80e-4b89a7a07126 service nova] Releasing lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] No waiting events found dispatching network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:03 user nova-compute[74319]: WARNING nova.compute.manager [req-02d6e88f-afcd-4b67-a574-5d7147919ae1 req-41b64a0b-dab2-4a7a-b86d-242aa23230ca service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received unexpected event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 for instance with vm_state building and task_state spawning.
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:02:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Instance spawned successfully.
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:03 user nova-compute[74319]: INFO nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Took 6.55 seconds to spawn the instance on the hypervisor.
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] No waiting events found dispatching network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:03 user nova-compute[74319]: WARNING nova.compute.manager [req-e0f2b30b-b1b8-422c-9a5a-74f49a591438 req-5c887cd3-6078-4a1c-bf01-10753dbb772a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received unexpected event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 for instance with vm_state building and task_state spawning.
Oct 30 14:02:03 user nova-compute[74319]: INFO nova.compute.manager [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Took 7.49 seconds to build instance.
Oct 30 14:02:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-57b6c322-d894-4adf-a7da-78f2e3fa1bb9 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.622s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] No waiting events found dispatching network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:05 user nova-compute[74319]: WARNING nova.compute.manager [req-b717480a-3db5-4843-9edb-3924433d0e8b req-1c4fc20c-b36b-4743-b6e3-2121b0c3afdd service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received unexpected event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 for instance with vm_state building and task_state spawning.
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:02:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Instance spawned successfully.
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:02:05 user nova-compute[74319]: INFO nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Took 6.65 seconds to spawn the instance on the hypervisor.
Oct 30 14:02:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:02:06 user nova-compute[74319]: INFO nova.compute.manager [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Took 7.84 seconds to build instance.
Oct 30 14:02:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bbb305ce-e3f2-47a7-91dc-006fb1e7b45b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.006s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing instance network info cache due to event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated VIF entry in instance network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8481ae5a-1949-4d0b-96d2-5d2e993c7c3f req-827e9259-4db5-429a-8dbc-f768f11704e8 service nova] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:02:19 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:21 user nova-compute[74319]: INFO nova.compute.manager [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Terminating instance
Oct 30 14:02:21 user nova-compute[74319]: DEBUG nova.compute.manager [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-unplugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] No waiting events found dispatching network-vif-unplugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8233702-0213-4362-9ea4-8cd3734b5f70 req-1e427dea-77c8-4071-bc4e-e1a2ac3a527e service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-unplugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:02:21 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Instance destroyed successfully.
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.objects.instance [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lazy-loading 'resources' on Instance uuid cb0d74e0-4263-4ee2-9db1-1615dd7efa24 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1575253195',display_name='tempest-VolumesAdminNegativeTest-server-1575253195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1575253195',id=5,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAn4BBWjV1G8wXg0I+oEnW4tFtRIQp+lKG+yBcz1dwBU8h8Mf2TGcedJclj5wqGl7I+SH5sD2x/dzH6deiNB/ffPMqbboYAs8PS/d+Hak+mIkHvv1dnVOFK1MIYyg7c7pQ==',key_name='tempest-keypair-256678168',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1966fa806de14afa86ce28be485ef471',ramdisk_id='',reservation_id='r-8dmymslh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-487685260',owner_user_name='tempest-VolumesAdminNegativeTest-487685260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:55:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6515419e258d4c978180f0a2fec90ecc',uuid=cb0d74e0-4263-4ee2-9db1-1615dd7efa24,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converting VIF {"id": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "address": "fa:16:3e:da:1b:13", "network": {"id": "80b7c719-071e-4dcc-b09f-9a7dcd86cc92", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1308668489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1966fa806de14afa86ce28be485ef471", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d13f00a-da", "ovs_interfaceid": "0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG os_vif [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d13f00a-da, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=286991a3-d226-4fc0-a2ca-77084b770e5e) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:22 user nova-compute[74319]: INFO os_vif [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:1b:13,bridge_name='br-int',has_traffic_filtering=True,id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d,network=Network(80b7c719-071e-4dcc-b09f-9a7dcd86cc92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d13f00a-da')
Oct 30 14:02:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Deleting instance files /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24_del
Oct 30 14:02:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Deletion of /opt/stack/data/nova/instances/cb0d74e0-4263-4ee2-9db1-1615dd7efa24_del complete
Oct 30 14:02:22 user nova-compute[74319]: INFO nova.compute.manager [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 30 14:02:22 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c89fcec-853f-42af-8f9c-a8a952192526 req-926a8b6b-1ec7-4830-b174-ae61271ccbcb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-deleted-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:23 user nova-compute[74319]: INFO nova.compute.manager [req-6c89fcec-853f-42af-8f9c-a8a952192526 req-926a8b6b-1ec7-4830-b174-ae61271ccbcb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Neutron deleted interface 0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d; detaching it from the instance and deleting it from the info cache
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.network.neutron [req-6c89fcec-853f-42af-8f9c-a8a952192526 req-926a8b6b-1ec7-4830-b174-ae61271ccbcb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:23 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Took 1.01 seconds to deallocate network for instance.
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-6c89fcec-853f-42af-8f9c-a8a952192526 req-926a8b6b-1ec7-4830-b174-ae61271ccbcb service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Detach interface failed, port_id=0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d, reason: Instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] Acquiring lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] No waiting events found dispatching network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:23 user nova-compute[74319]: WARNING nova.compute.manager [req-8722efc7-1d09-44fa-a531-12a2e0831146 req-ef55b402-c605-47fc-9066-f422357eb594 service nova] [instance: cb0d74e0-4263-4ee2-9db1-1615dd7efa24] Received unexpected event network-vif-plugged-0d13f00a-da3e-4b13-b9a9-ea0eb9aeaa5d for instance with vm_state deleted and task_state None.
Oct 30 14:02:23 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Deleted allocations for instance cb0d74e0-4263-4ee2-9db1-1615dd7efa24
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-372bd310-9602-400e-8b7b-02c760878884 tempest-VolumesAdminNegativeTest-487685260 tempest-VolumesAdminNegativeTest-487685260-project-member] Lock "cb0d74e0-4263-4ee2-9db1-1615dd7efa24" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:26 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:02:26 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7695MB free_disk=25.554237365722656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 40d154bd-570e-47ee-be88-9e6cfa3463fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ebc3e67-eb79-4e83-94d1-ce44281f7007 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2737c88d-9a65-49c1-9ba6-988e3434b99d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:02:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [{"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-67280b94-8d8c-47ce-800d-a88d7de8e3d3" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:02:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:02:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:35 user nova-compute[74319]: INFO nova.compute.manager [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Terminating instance
Oct 30 14:02:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-unplugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] No waiting events found dispatching network-vif-unplugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-4de9bcf2-a148-409e-86b9-0480c536de11 req-3f80c8a6-61bc-40b6-8b33-8d3f54614e93 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-unplugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Instance destroyed successfully.
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.objects.instance [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lazy-loading 'resources' on Instance uuid bb5d67f1-e3ef-41ae-94f1-29c29eb30388 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T13:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-307491263',display_name='tempest-ServerActionsTestOtherB-server-307491263',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-307491263',id=2,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrzIEhweMKLwYJIjHXoHcltfLtDk8f0POK0GdiuUtbxBvnI/VYzVgSx5bTw7QrxQ7FcxBALaQBhI0X3rjhL11Fc1mAcBl/DB4NeU3XkhKF8PjhaWfffN62Ggq98UQ91dw==',key_name='tempest-keypair-272861040',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:54:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='787db3f3dd724d9f9d5c61ade8682b35',ramdisk_id='',reservation_id='r-4x52z5lz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-309973993',owner_user_name='tempest-ServerActionsTestOtherB-309973993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T13:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='48a1732c4db44f33a372ab2e8521b773',uuid=bb5d67f1-e3ef-41ae-94f1-29c29eb30388,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converting VIF {"id": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "address": "fa:16:3e:43:d7:b6", "network": {"id": "1773a004-158e-4263-9062-5b8c314179f9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1548723684-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "787db3f3dd724d9f9d5c61ade8682b35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape6e238f7-af", "ovs_interfaceid": "e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG os_vif [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape6e238f7-af, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ade02fe-bbe0-4d38-bcde-b7d38832fded) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:36 user nova-compute[74319]: INFO os_vif [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d7:b6,bridge_name='br-int',has_traffic_filtering=True,id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1,network=Network(1773a004-158e-4263-9062-5b8c314179f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape6e238f7-af')
Oct 30 14:02:36 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Deleting instance files /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388_del
Oct 30 14:02:36 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Deletion of /opt/stack/data/nova/instances/bb5d67f1-e3ef-41ae-94f1-29c29eb30388_del complete
Oct 30 14:02:36 user nova-compute[74319]: INFO nova.compute.manager [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 30 14:02:36 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:02:36 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:37 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Took 0.70 seconds to deallocate network for instance.
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-c6f858da-d420-44b7-847e-a6dffd2e8978 req-d3ff99a8-0a26-4e64-97d8-e6b620614a56 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-deleted-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:37 user nova-compute[74319]: INFO nova.compute.manager [req-c6f858da-d420-44b7-847e-a6dffd2e8978 req-d3ff99a8-0a26-4e64-97d8-e6b620614a56 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Neutron deleted interface e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1; detaching it from the instance and deleting it from the info cache
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-c6f858da-d420-44b7-847e-a6dffd2e8978 req-d3ff99a8-0a26-4e64-97d8-e6b620614a56 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-c6f858da-d420-44b7-847e-a6dffd2e8978 req-d3ff99a8-0a26-4e64-97d8-e6b620614a56 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Detach interface failed, port_id=e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1, reason: Instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:02:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:37 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Deleted allocations for instance bb5d67f1-e3ef-41ae-94f1-29c29eb30388
Oct 30 14:02:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-15dbe85f-d537-4c47-83bc-3e3bea6c6480 tempest-ServerActionsTestOtherB-309973993 tempest-ServerActionsTestOtherB-309973993-project-member] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.798s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:02:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] Acquiring lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:02:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:02:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] Lock "bb5d67f1-e3ef-41ae-94f1-29c29eb30388-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:02:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] No waiting events found dispatching network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:02:38 user nova-compute[74319]: WARNING nova.compute.manager [req-46bedaad-f88e-4d90-946c-454158f44df7 req-8a5a35b7-6214-4e5b-82e0-55049f1afb99 service nova] [instance: bb5d67f1-e3ef-41ae-94f1-29c29eb30388] Received unexpected event network-vif-plugged-e6e238f7-af09-4fa5-bc6c-fd5aeb92bee1 for instance with vm_state deleted and task_state None.
Oct 30 14:02:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:02:46 user nova-compute[74319]: INFO nova.compute.manager [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] instance snapshotting
Oct 30 14:02:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Beginning live snapshot process
Oct 30 14:02:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7.delta 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7.delta 1073741824" returned: 0 in 0.047s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 14:02:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:02:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:02:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:02:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 14:02:49 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:02:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7.delta /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:02:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7.delta /opt/stack/data/nova/instances/snapshots/tmpnbpb_zlg/9b6f8febf41b41d386306d166d6697f7" returned: 0 in 0.493s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:02:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Snapshot extracted, beginning image upload
Oct 30 14:02:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:02:52 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Snapshot image upload complete
Oct 30 14:02:52 user nova-compute[74319]: INFO nova.compute.manager [None req-752c4a9a-8de4-4046-baa0-24fc24ec4b54 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Took 5.98 seconds to snapshot the instance on the hypervisor.
Oct 30 14:02:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:03:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:21 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:25 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:03:25 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:03:25 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8087MB free_disk=25.525440216064453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 40d154bd-570e-47ee-be88-9e6cfa3463fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ebc3e67-eb79-4e83-94d1-ce44281f7007 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2737c88d-9a65-49c1-9ba6-988e3434b99d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:03:29 user nova-compute[74319]: INFO nova.compute.claims [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Claim successful on node user
Oct 30 14:03:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.policy [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72f5d276e62a472b92e46d28aa5a5286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173b99e7da54c6688ccc9969dbaa7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:03:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Creating image(s)
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.015s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updating instance_info_cache with network_info: [{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk 1073741824" returned: 0 in 0.061s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Successfully created port: d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Cannot resize image /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Ensure instance console log exists: /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Successfully updated port: d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing instance network info cache due to event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:03:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance network_info: |[{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.neutron [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start _get_guest_xml network_info=[{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:03:32 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:03:32 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhnZsHN9yo6cWW7C3RXnaqTKtPxxMABjJ7Zf2j+Pt8HBXRqzqEHxAwf+igL3OWSUOKSZkHY8zq+H5wuv8nC2wg07izK4tJ8LKlG8O2/jrOhi06bvLBtPcwt8KKzSFD7dA==',key_name='tempest-keypair-1275219634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_devices' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:03:32 user nova-compute[74319]:   <uuid>00bf4369-a4dd-463a-ac55-12625d0a81a2</uuid>
Oct 30 14:03:32 user nova-compute[74319]:   <name>instance-00000013</name>
Oct 30 14:03:32 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:03:32 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:03:32 user nova-compute[74319]:   <metadata>
Oct 30 14:03:32 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:03:32 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2051727474</nova:name>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:03:32</nova:creationTime>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:03:32 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:03:32 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:owner>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:user uuid="72f5d276e62a472b92e46d28aa5a5286">tempest-AttachVolumeShelveTestJSON-282209841-project-member</nova:user>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:project uuid="e173b99e7da54c6688ccc9969dbaa7f4">tempest-AttachVolumeShelveTestJSON-282209841</nova:project>
Oct 30 14:03:32 user nova-compute[74319]:       </nova:owner>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:03:32 user nova-compute[74319]:       <nova:ports>
Oct 30 14:03:32 user nova-compute[74319]:         <nova:port uuid="d4d45c22-1233-41d7-835a-23ff10d39344">
Oct 30 14:03:32 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:03:32 user nova-compute[74319]:         </nova:port>
Oct 30 14:03:32 user nova-compute[74319]:       </nova:ports>
Oct 30 14:03:32 user nova-compute[74319]:     </nova:instance>
Oct 30 14:03:32 user nova-compute[74319]:   </metadata>
Oct 30 14:03:32 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:03:32 user nova-compute[74319]:     <system>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="serial">00bf4369-a4dd-463a-ac55-12625d0a81a2</entry>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="uuid">00bf4369-a4dd-463a-ac55-12625d0a81a2</entry>
Oct 30 14:03:32 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:03:32 user nova-compute[74319]:     </system>
Oct 30 14:03:32 user nova-compute[74319]:   </sysinfo>
Oct 30 14:03:32 user nova-compute[74319]:   <os>
Oct 30 14:03:32 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:03:32 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:03:32 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:03:32 user nova-compute[74319]:   </os>
Oct 30 14:03:32 user nova-compute[74319]:   <features>
Oct 30 14:03:32 user nova-compute[74319]:     <acpi/>
Oct 30 14:03:32 user nova-compute[74319]:     <apic/>
Oct 30 14:03:32 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:03:32 user nova-compute[74319]:   </features>
Oct 30 14:03:32 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:03:32 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:03:32 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:03:32 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:03:32 user nova-compute[74319]:   </clock>
Oct 30 14:03:32 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:03:32 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:03:32 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:03:32 user nova-compute[74319]:   </cpu>
Oct 30 14:03:32 user nova-compute[74319]:   <devices>
Oct 30 14:03:32 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:03:32 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:03:32 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk"/>
Oct 30 14:03:32 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:03:32 user nova-compute[74319]:     </disk>
Oct 30 14:03:32 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:03:32 user nova-compute[74319]:       <mac address="fa:16:3e:39:2f:66"/>
Oct 30 14:03:32 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:03:32 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:03:32 user nova-compute[74319]:       <target dev="tapd4d45c22-12"/>
Oct 30 14:03:32 user nova-compute[74319]:     </interface>
Oct 30 14:03:32 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:03:32 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/console.log" append="off"/>
Oct 30 14:03:32 user nova-compute[74319]:     </serial>
Oct 30 14:03:32 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:03:32 user nova-compute[74319]:     <video>
Oct 30 14:03:32 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:03:32 user nova-compute[74319]:     </video>
Oct 30 14:03:32 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:03:32 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:03:32 user nova-compute[74319]:     </rng>
Oct 30 14:03:32 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:03:32 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:03:32 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:03:32 user nova-compute[74319]:     </memballoon>
Oct 30 14:03:32 user nova-compute[74319]:   </devices>
Oct 30 14:03:32 user nova-compute[74319]: </domain>
Oct 30 14:03:32 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhnZsHN9yo6cWW7C3RXnaqTKtPxxMABjJ7Zf2j+Pt8HBXRqzqEHxAwf+igL3OWSUOKSZkHY8zq+H5wuv8nC2wg07izK4tJ8LKlG8O2/jrOhi06bvLBtPcwt8KKzSFD7dA==',key_name='tempest-keypair-1275219634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG os_vif [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61fda8ad-d4d5-5ffd-87be-0074f9ff2d1c', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d45c22-12, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4d45c22-12, col_values=(('qos', UUID('bdcf7a03-a423-438a-b4d8-bb3aac3e7459')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4d45c22-12, col_values=(('external_ids', {'iface-id': 'd4d45c22-1233-41d7-835a-23ff10d39344', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2f:66', 'vm-uuid': '00bf4369-a4dd-463a-ac55-12625d0a81a2'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:32 user nova-compute[74319]: INFO os_vif [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12')
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:03:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No VIF found with MAC fa:16:3e:39:2f:66, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:03:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updated VIF entry in instance network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:03:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0cfcfa70-3339-4674-8b40-f3e2e0f4230c req-e28d8382-e4d0-4536-9aed-7a0b486ab6e3 service nova] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:03:34 user nova-compute[74319]: WARNING nova.compute.manager [req-5844d871-a333-4576-a191-f123063874d1 req-f091c0c7-d254-4fc4-a7eb-37af61fe4704 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state building and task_state spawning.
Oct 30 14:03:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:03:36 user nova-compute[74319]: WARNING nova.compute.manager [req-e8c87a4f-216e-4f0b-8b2f-705c82480126 req-3500772e-8687-4e32-8cba-8d55b75ed5f0 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state building and task_state spawning.
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:03:36 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance spawned successfully.
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:03:36 user nova-compute[74319]: INFO nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Took 6.23 seconds to spawn the instance on the hypervisor.
Oct 30 14:03:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:03:36 user nova-compute[74319]: INFO nova.compute.manager [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Took 7.11 seconds to build instance.
Oct 30 14:03:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fc01e3a3-4f57-415d-b1fb-cec0ae77914d tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.227s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lazy-loading 'flavor' on Instance uuid 40d154bd-570e-47ee-be88-9e6cfa3463fe {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.082s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:44 user nova-compute[74319]: INFO nova.compute.manager [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Attaching volume cc36cf09-b1c8-4378-93f1-165fbf5d2112 to /dev/vdb
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.utils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d3168-30ea-4f06-8b93-612d88ebe470]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ed94d0-ccae-4576-af0c-94938c28d857]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96431df3-ed31-4a63-9806-a86c8de97baa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3422fc-c4be-496d-ae38-aa44185bd9d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:03:44 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:03:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba25a697-a5c8-40d7-bdaf-e6f3c55a1b9e]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG os_brick.utils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:03:44 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updating existing volume attachment record: 67f18c21-2c67-41fd-9c5b-76f50f45fe0e {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:45 user nova-compute[74319]: INFO nova.compute.manager [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Terminating instance
Oct 30 14:03:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-unplugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] No waiting events found dispatching network-vif-unplugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-65dede6b-b690-408d-ad30-8e6b8af27c2b req-e41f35bb-fcfd-4193-9be8-2b69656ba0fb service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-unplugged-29db6805-71ea-4c40-9869-7ed058ea5d33 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Instance destroyed successfully.
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.objects.instance [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lazy-loading 'resources' on Instance uuid 7ebc3e67-eb79-4e83-94d1-ce44281f7007 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-200165636',display_name='tempest-ServersNegativeTestJSON-server-200165636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-200165636',id=17,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:02:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-ie5h8j4a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:02:03Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=7ebc3e67-eb79-4e83-94d1-ce44281f7007,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "29db6805-71ea-4c40-9869-7ed058ea5d33", "address": "fa:16:3e:2f:0c:59", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29db6805-71", "ovs_interfaceid": "29db6805-71ea-4c40-9869-7ed058ea5d33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG os_vif [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29db6805-71, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b698cd8-e52c-4644-b1b7-d71d637eed75) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:03:46 user nova-compute[74319]: INFO os_vif [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:0c:59,bridge_name='br-int',has_traffic_filtering=True,id=29db6805-71ea-4c40-9869-7ed058ea5d33,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29db6805-71')
Oct 30 14:03:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Deleting instance files /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007_del
Oct 30 14:03:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Deletion of /opt/stack/data/nova/instances/7ebc3e67-eb79-4e83-94d1-ce44281f7007_del complete
Oct 30 14:03:46 user nova-compute[74319]: INFO nova.compute.manager [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 14:03:46 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:03:46 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:47 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Took 0.49 seconds to deallocate network for instance.
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c8e48f2-8ca5-47a7-a883-881a9a8d5e67 req-c743dc8f-c035-4866-9ad9-b43bae951e6f service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-deleted-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:47 user nova-compute[74319]: INFO nova.compute.manager [req-2c8e48f2-8ca5-47a7-a883-881a9a8d5e67 req-c743dc8f-c035-4866-9ad9-b43bae951e6f service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Neutron deleted interface 29db6805-71ea-4c40-9869-7ed058ea5d33; detaching it from the instance and deleting it from the info cache
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.network.neutron [req-2c8e48f2-8ca5-47a7-a883-881a9a8d5e67 req-c743dc8f-c035-4866-9ad9-b43bae951e6f service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c8e48f2-8ca5-47a7-a883-881a9a8d5e67 req-c743dc8f-c035-4866-9ad9-b43bae951e6f service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Detach interface failed, port_id=29db6805-71ea-4c40-9869-7ed058ea5d33, reason: Instance 7ebc3e67-eb79-4e83-94d1-ce44281f7007 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:03:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:47 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Deleted allocations for instance 7ebc3e67-eb79-4e83-94d1-ce44281f7007
Oct 30 14:03:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-371ff622-bf37-45df-92e0-2c51909ddcc2 tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] Acquiring lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] Lock "7ebc3e67-eb79-4e83-94d1-ce44281f7007-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] No waiting events found dispatching network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:03:48 user nova-compute[74319]: WARNING nova.compute.manager [req-d6a1bcea-3f4b-4c89-a07c-d35119d9cf2e req-a6c111a4-4e03-475d-a531-ee36152efb98 service nova] [instance: 7ebc3e67-eb79-4e83-94d1-ce44281f7007] Received unexpected event network-vif-plugged-29db6805-71ea-4c40-9869-7ed058ea5d33 for instance with vm_state deleted and task_state None.
Oct 30 14:03:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-changed-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Refreshing instance network info cache due to event network-changed-7be24740-a682-4688-9c44-14ae3b084a09. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] Acquiring lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] Acquired lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Refreshing network info cache for port 7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updated VIF entry in instance network info cache for port 7be24740-a682-4688-9c44-14ae3b084a09. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updating instance_info_cache with network_info: [{"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-66c209a5-5625-44b3-9280-0784818e2ae7 req-29337469-7919-4f20-8b0a-0c24b582a44a service nova] Releasing lock "refresh_cache-2737c88d-9a65-49c1-9ba6-988e3434b99d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:03:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.objects.instance [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:03:55 user nova-compute[74319]: INFO nova.compute.claims [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Claim successful on node user
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:03:55 user nova-compute[74319]: INFO nova.compute.manager [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Attaching volume 09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 to /dev/vdb
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.utils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe3228-7cd0-4fad-8063-1d7aabb9c7a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb60fc1b-3012-4693-9888-7253e933204c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6f0a49-ba2e-457a-99ab-04058dd93821]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f5aba-ab91-4d8a-883b-6f3f7e640f22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:03:55 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49cf54-69ce-4cb7-8fb1-8b4c794a418f]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG os_brick.utils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updating existing volume attachment record: b274eaab-4d75-4b58-a16d-e24e33114211 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:03:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:03:55 user nova-compute[74319]: DEBUG nova.policy [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a708010243464fe9bbf96c2e0e79a0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f2668e6b874840ad286ca9a8189fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:03:55 user nova-compute[74319]: INFO nova.virt.block_device [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Booting with blank volume at /dev/vda
Oct 30 14:03:56 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Successfully created port: b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:03:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Successfully updated port: b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-changed-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Refreshing instance network info cache due to event network-changed-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance network_info: |[{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:03:57 user nova-compute[74319]: DEBUG nova.network.neutron [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Refreshing network info cache for port b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:03:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updated VIF entry in instance network info cache for port b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:03:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:03:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31ab827c-a53c-48ae-975c-96b20f5bd96d req-2d680433-feac-4d0f-8727-4ba608689b3a service nova] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:04:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[188c1be3-e034-4f97-a357-3c8f3824de32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[399c471f-df89-4a87-b938-f0270bf66c24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0492c28-c16a-428d-811b-f2b1a611a3a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39ff47c-dc4b-4dc7-b23b-583768f554e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:04:01 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:04:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149021c-1510-41ab-9e27-34192c798fe8]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:01 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating existing volume attachment record: c8d90feb-ded0-4c2b-87fe-1837597d2682 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:04:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnwtJsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:12 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:12 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:12 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af4dcbb-38b8-4c91-9336-6f0b04cbdb08]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:04:12 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bf7d8b-3394-4f6d-8dd0-2a3496cec314]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112] added
Oct 30 14:04:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fdfa3e-a7f7-4201-b0a7-d10937196873]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9185c77-389e-4766-9251-52b1bd2ed11b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnwtJsN {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnwtJsN" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bd5a80-66d7-4a7e-a816-154b3a77efee]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQnwtJsN'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bff9dbe-2afe-4a20-8d7f-07d595255986]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[11863728-6fa7-407f-a623-d3c959242408]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:04:12 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:04:12 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:12 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:04:12 user nova-compute[74319]: 
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7a85b-6191-46f4-ae57-40a26b0ddc3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260]
Oct 30 14:04:12 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260] successful.
Oct 30 14:04:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73dc602-4476-4268-af82-5f2de14f71c1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af2e061-23fc-4cf4-8dbf-754b5f3d3f9e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)
Oct 30 14:04:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)
Oct 30 14:04:12 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b674df5-f76e-4eea-a24a-12a8da285f7d]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:04:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnwtJsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:04:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23035633734363835', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035633734363835', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:04:13 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lazy-loading 'flavor' on Instance uuid 40d154bd-570e-47ee-be88-9e6cfa3463fe {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:04:13 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:04:13 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:04:13 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:04:13 user nova-compute[74319]:   <serial>cc36cf09-b1c8-4378-93f1-165fbf5d2112</serial>
Oct 30 14:04:13 user nova-compute[74319]: </disk>
Oct 30 14:04:13 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] No VIF found with MAC fa:16:3e:59:b0:b1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4d996716-4e4a-4e32-914b-91e1cbbb4e10 tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.735s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:14 user nova-compute[74319]: INFO nova.compute.manager [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Terminating instance
Oct 30 14:04:14 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-unplugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] No waiting events found dispatching network-vif-unplugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-167f8323-0868-485e-988a-e38c8252576d req-828534da-5fda-49aa-846a-7663a1476f69 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-unplugged-00680d07-135d-4d2d-aba4-96603ad216b8 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:04:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Instance destroyed successfully.
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lazy-loading 'resources' on Instance uuid 40d154bd-570e-47ee-be88-9e6cfa3463fe {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1127611427',display_name='tempest-DeleteServersTestJSON-server-1127611427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1127611427',id=16,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:01:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d8bd07cd0f84c1a9d10b5cb28c3f617',ramdisk_id='',reservation_id='r-3w65nqag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2102119684',owner_user_name='tempest-DeleteServersTestJSON-2102119684-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:01:55Z,user_data=None,user_id='8c78dc89d1754b9bbf4c7765ae964424',uuid=40d154bd-570e-47ee-be88-9e6cfa3463fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converting VIF {"id": "00680d07-135d-4d2d-aba4-96603ad216b8", "address": "fa:16:3e:59:b0:b1", "network": {"id": "fd96cedd-27dd-42d0-bfe1-1d18fd91d54f", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-578122340-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d8bd07cd0f84c1a9d10b5cb28c3f617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap00680d07-13", "ovs_interfaceid": "00680d07-135d-4d2d-aba4-96603ad216b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_vif [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap00680d07-13, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2823717c-302f-40e5-a817-6ae19673a71b) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:15 user nova-compute[74319]: INFO os_vif [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:b0:b1,bridge_name='br-int',has_traffic_filtering=True,id=00680d07-135d-4d2d-aba4-96603ad216b8,network=Network(fd96cedd-27dd-42d0-bfe1-1d18fd91d54f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap00680d07-13')
Oct 30 14:04:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnwtJsN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:15 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a03c0-8996-4d13-ac73-3ecf322af896]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:04:15 user nova-compute[74319]: No targets found.
Oct 30 14:04:15 user nova-compute[74319]: iSNS:
Oct 30 14:04:15 user nova-compute[74319]: No targets found.
Oct 30 14:04:15 user nova-compute[74319]: STATIC:
Oct 30 14:04:15 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112
Oct 30 14:04:15 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:04:15 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:04:15 user nova-compute[74319]: FIRMWARE:
Oct 30 14:04:15 user nova-compute[74319]: No targets found.
Oct 30 14:04:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:04:15 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:04:15 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[784fe13b-bd53-41d6-8f8c-d5820bf85ee5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64446e4-3af8-477a-a031-1377f7dd447a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)
Oct 30 14:04:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 (non-flash)
Oct 30 14:04:15 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99869bf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:04:15 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3262cc-bbf7-4b86-a51b-56aeb550f567]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5759fab6-a516-4324-9312-8585d6c1ca3d]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b066e96-b3bb-4b84-a4ea-08a4e810cb0d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[394bb887-ea47-43e7-b330-fb217e64b6be]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f7ea2-70cf-48ac-85a4-9bfefb563013]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a105f0-e831-4311-8d53-ba984f8bf4a0]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260]
Oct 30 14:04:16 user nova-compute[74319]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112, portal: 172.16.0.220,3260] successful.
Oct 30 14:04:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc36cf09-b1c8-4378-93f1-165fbf5d2112 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4b4735-6813-4197-9fed-7f196fcda14d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] <== disconnect_volume: return (322ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:04:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Deleting instance files /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe_del
Oct 30 14:04:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Deletion of /opt/stack/data/nova/instances/40d154bd-570e-47ee-be88-9e6cfa3463fe_del complete
Oct 30 14:04:16 user nova-compute[74319]: INFO nova.compute.manager [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VToPpyCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:16 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:16 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:16 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[742d1750-c2ea-4dcd-a6b9-2119e47a5c53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:04:16 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c4cd1c-ecd1-4da1-b92e-cfd9b29c691c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934] added
Oct 30 14:04:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b07a48-c8c9-4076-86aa-f99df1fe3671]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b24fee-43fc-4059-9f38-eb49c5433296]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VToPpyCb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VToPpyCb" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f9ff63-5997-479e-a722-22623b10f897]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VToPpyCb'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f82d334-0fe9-4916-9ce2-cb20e6f197cc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[399436d0-1518-4376-ac0b-c1b4e48237b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:04:16 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:04:16 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:16 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:04:16 user nova-compute[74319]: 
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:04:16 user nova-compute[74319]: INFO nova.compute.claims [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Claim successful on node user
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4708f722-1885-443d-b536-bd46b50bdf93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260]
Oct 30 14:04:16 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260] successful.
Oct 30 14:04:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[966342ac-3215-4b8b-a246-462794cee5fc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29040bd0-d698-4db4-ac23-c230b017a0e8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:16 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b0b0f8-a087-4666-84ad-98589a24f89f]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:04:16 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VToPpyCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:04:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:04:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Creating image(s)
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.policy [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd03a462b75b14b4fb30f66a3b0e051d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae8f2e2f199408596776c53c41a7986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-51910016-6341-4ba1-b065-a91590b8951a req-b6f6948f-6d16-46e2-b8f0-166dc012a6b9 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-deleted-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:17 user nova-compute[74319]: INFO nova.compute.manager [req-51910016-6341-4ba1-b065-a91590b8951a req-b6f6948f-6d16-46e2-b8f0-166dc012a6b9 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Neutron deleted interface 00680d07-135d-4d2d-aba4-96603ad216b8; detaching it from the instance and deleting it from the info cache
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-51910016-6341-4ba1-b065-a91590b8951a req-b6f6948f-6d16-46e2-b8f0-166dc012a6b9 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:17 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Took 1.30 seconds to deallocate network for instance.
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] Acquiring lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] No waiting events found dispatching network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:17 user nova-compute[74319]: WARNING nova.compute.manager [req-60f4ab28-05dd-42a0-9e1f-42bd10df3b78 req-7094215d-0995-4209-a00d-8fea7a1d871d service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Received unexpected event network-vif-plugged-00680d07-135d-4d2d-aba4-96603ad216b8 for instance with vm_state active and task_state deleting.
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-51910016-6341-4ba1-b065-a91590b8951a req-b6f6948f-6d16-46e2-b8f0-166dc012a6b9 service nova] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Detach interface failed, port_id=00680d07-135d-4d2d-aba4-96603ad216b8, reason: Instance 40d154bd-570e-47ee-be88-9e6cfa3463fe could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23464643466396636', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464643466396636', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.objects.instance [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:04:17 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:04:17 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:04:17 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:04:17 user nova-compute[74319]:   <serial>09e7fa67-792c-41ae-b2ab-6dfa4d8d9934</serial>
Oct 30 14:04:17 user nova-compute[74319]: </disk>
Oct 30 14:04:17 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.211s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk 1073741824" returned: 0 in 0.056s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Successfully created port: 2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Cannot resize image /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Ensure instance console log exists: /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:b6:3c:8f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:04:18 user nova-compute[74319]: INFO nova.compute.manager [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] [instance: 40d154bd-570e-47ee-be88-9e6cfa3463fe] Took 0.97 seconds to detach 1 volumes for instance.
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-95b235a8-0600-4821-8a0e-9bb9ae518eb4 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.258s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:04:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:19 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Deleted allocations for instance 40d154bd-570e-47ee-be88-9e6cfa3463fe
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Successfully updated port: 2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0f8dbf9d-e086-44d9-a03c-5379307b736a tempest-DeleteServersTestJSON-2102119684 tempest-DeleteServersTestJSON-2102119684-project-member] Lock "40d154bd-570e-47ee-be88-9e6cfa3463fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.295s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating instance_info_cache with network_info: [{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance network_info: |[{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start _get_guest_xml network_info=[{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:04:19 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:19 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-tempest.common.compute-instance-986593302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.objects.instance [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'pci_devices' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:04:19 user nova-compute[74319]:   <uuid>e386fa6a-5c77-4482-9bd7-4d3ef21cf802</uuid>
Oct 30 14:04:19 user nova-compute[74319]:   <name>instance-00000015</name>
Oct 30 14:04:19 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:04:19 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:04:19 user nova-compute[74319]:   <metadata>
Oct 30 14:04:19 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:04:19 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:name>tempest-tempest.common.compute-instance-986593302</nova:name>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:04:19</nova:creationTime>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:04:19 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:04:19 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:owner>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:user uuid="d03a462b75b14b4fb30f66a3b0e051d4">tempest-ServerActionsTestOtherA-768990641-project-member</nova:user>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:project uuid="0ae8f2e2f199408596776c53c41a7986">tempest-ServerActionsTestOtherA-768990641</nova:project>
Oct 30 14:04:19 user nova-compute[74319]:       </nova:owner>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:04:19 user nova-compute[74319]:       <nova:ports>
Oct 30 14:04:19 user nova-compute[74319]:         <nova:port uuid="2511e72f-9d7c-488f-9430-a33f351f40bb">
Oct 30 14:04:19 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:04:19 user nova-compute[74319]:         </nova:port>
Oct 30 14:04:19 user nova-compute[74319]:       </nova:ports>
Oct 30 14:04:19 user nova-compute[74319]:     </nova:instance>
Oct 30 14:04:19 user nova-compute[74319]:   </metadata>
Oct 30 14:04:19 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:04:19 user nova-compute[74319]:     <system>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="serial">e386fa6a-5c77-4482-9bd7-4d3ef21cf802</entry>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="uuid">e386fa6a-5c77-4482-9bd7-4d3ef21cf802</entry>
Oct 30 14:04:19 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:04:19 user nova-compute[74319]:     </system>
Oct 30 14:04:19 user nova-compute[74319]:   </sysinfo>
Oct 30 14:04:19 user nova-compute[74319]:   <os>
Oct 30 14:04:19 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:04:19 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:04:19 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:04:19 user nova-compute[74319]:   </os>
Oct 30 14:04:19 user nova-compute[74319]:   <features>
Oct 30 14:04:19 user nova-compute[74319]:     <acpi/>
Oct 30 14:04:19 user nova-compute[74319]:     <apic/>
Oct 30 14:04:19 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:04:19 user nova-compute[74319]:   </features>
Oct 30 14:04:19 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:04:19 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:04:19 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:04:19 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:04:19 user nova-compute[74319]:   </clock>
Oct 30 14:04:19 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:04:19 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:04:19 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:04:19 user nova-compute[74319]:   </cpu>
Oct 30 14:04:19 user nova-compute[74319]:   <devices>
Oct 30 14:04:19 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:04:19 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:04:19 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk"/>
Oct 30 14:04:19 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:04:19 user nova-compute[74319]:     </disk>
Oct 30 14:04:19 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:04:19 user nova-compute[74319]:       <mac address="fa:16:3e:d2:49:67"/>
Oct 30 14:04:19 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:04:19 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:04:19 user nova-compute[74319]:       <target dev="tap2511e72f-9d"/>
Oct 30 14:04:19 user nova-compute[74319]:     </interface>
Oct 30 14:04:19 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:04:19 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/console.log" append="off"/>
Oct 30 14:04:19 user nova-compute[74319]:     </serial>
Oct 30 14:04:19 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:04:19 user nova-compute[74319]:     <video>
Oct 30 14:04:19 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:04:19 user nova-compute[74319]:     </video>
Oct 30 14:04:19 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:04:19 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:04:19 user nova-compute[74319]:     </rng>
Oct 30 14:04:19 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:04:19 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:04:19 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:04:19 user nova-compute[74319]:     </memballoon>
Oct 30 14:04:19 user nova-compute[74319]:   </devices>
Oct 30 14:04:19 user nova-compute[74319]: </domain>
Oct 30 14:04:19 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-tempest.common.compute-instance-986593302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:04:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG os_vif [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e47a755-d664-524e-bfd5-0a06e180c37d', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2511e72f-9d, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2511e72f-9d, col_values=(('qos', UUID('d6cfc509-2663-463b-b563-eff867880e28')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2511e72f-9d, col_values=(('external_ids', {'iface-id': '2511e72f-9d7c-488f-9430-a33f351f40bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:49:67', 'vm-uuid': 'e386fa6a-5c77-4482-9bd7-4d3ef21cf802'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:19 user nova-compute[74319]: INFO os_vif [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d')
Oct 30 14:04:19 user nova-compute[74319]: INFO nova.compute.manager [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Detaching volume 09e7fa67-792c-41ae-b2ab-6dfa4d8d9934
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-changed-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Refreshing instance network info cache due to event network-changed-2511e72f-9d7c-488f-9430-a33f351f40bb. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] Acquiring lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] Acquired lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Refreshing network info cache for port 2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:04:19 user nova-compute[74319]: INFO nova.virt.block_device [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Attempting to driver detach volume 09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 from mountpoint /dev/vdb
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:d2:49:67, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Attempting to detach device vdb from instance 2737c88d-9a65-49c1-9ba6-988e3434b99d from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:04:19 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:04:19 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:04:19 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:04:19 user nova-compute[74319]:   <serial>09e7fa67-792c-41ae-b2ab-6dfa4d8d9934</serial>
Oct 30 14:04:19 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:04:19 user nova-compute[74319]: </disk>
Oct 30 14:04:19 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:04:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance 2737c88d-9a65-49c1-9ba6-988e3434b99d from the persistent domain config.
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2737c88d-9a65-49c1-9ba6-988e3434b99d from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:04:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:04:19 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:04:19 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:04:19 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:04:19 user nova-compute[74319]:   <serial>09e7fa67-792c-41ae-b2ab-6dfa4d8d9934</serial>
Oct 30 14:04:19 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:04:19 user nova-compute[74319]: </disk>
Oct 30 14:04:19 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:04:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updated VIF entry in instance network info cache for port 2511e72f-9d7c-488f-9430-a33f351f40bb. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:04:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating instance_info_cache with network_info: [{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e96330a9-1a67-49bb-885e-060deea19ee4 req-1fc8368c-1137-40d1-bddc-e3e4490011f2 service nova] Releasing lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:04:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:21 user nova-compute[74319]: WARNING nova.compute.manager [req-1355d020-d720-4b21-bb09-6eb4f87d3c35 req-e0ee6cdc-22f8-4670-bb7f-68d6bb85a710 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state building and task_state spawning.
Oct 30 14:04:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:22 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:04:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Creating image(s)
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Ensure instance console log exists: /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start _get_guest_xml network_info=[{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'c8d90feb-ded0-4c2b-87fe-1837597d2682', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3fb6cc13-e069-46bc-9b0b-50fe57103fd5', 'attached_at': '', 'detached_at': '', 'volume_id': '4af4e65e-97af-4a89-b347-79e53e94f14f', 'serial': '4af4e65e-97af-4a89-b347-79e53e94f14f'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:04:23 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:23 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:23 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:23 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:23 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdd3aba-dc74-4716-ba39-bd5a5d10b711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:04:23 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3884c6eb-bedf-4129-96c1-80f96dfe52ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f] added
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92e8939-856d-4587-87ca-98f7b29a63d5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[59623644-4fc9-4eac-bc7f-cad639e56be6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrjeKdys {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrjeKdys" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0667ecb8-85c0-42c4-b619-cc765ce1e5fd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrjeKdys'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb64b520-8244-4aa0-b07e-90d21ddf7814]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893c342-7924-4a71-8602-4d3968deec70]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d021871-36ca-4377-958d-96810fb6e218]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260]
Oct 30 14:04:23 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260] successful.
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[386c4039-df23-493e-a1f7-d8e5ec537c30]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff73e2b-a11b-4a27-a661-2058d59e46fe]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:23 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:23 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b437142-b880-45ca-a9ec-e9ebdadb1058]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:04:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance spawned successfully.
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:23 user nova-compute[74319]: WARNING nova.compute.manager [req-cb92e761-4ad9-4217-b634-1e520894d921 req-a425d83a-3115-4b66-9d7d-cad598a982bc service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state building and task_state spawning.
Oct 30 14:04:23 user nova-compute[74319]: INFO nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 30 14:04:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:23 user nova-compute[74319]: INFO nova.compute.manager [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Took 7.27 seconds to build instance.
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-931d24cc-f766-4808-aac3-16d73c7bfae2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.439s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23731633031393366', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633031393366', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1439463144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1439463144',id=20,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-jx544glu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:03:56Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=3fb6cc13-e069-46bc-9b0b-50fe57103fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:04:24 user nova-compute[74319]:   <uuid>3fb6cc13-e069-46bc-9b0b-50fe57103fd5</uuid>
Oct 30 14:04:24 user nova-compute[74319]:   <name>instance-00000014</name>
Oct 30 14:04:24 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:04:24 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:04:24 user nova-compute[74319]:   <metadata>
Oct 30 14:04:24 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:04:24 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1439463144</nova:name>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:04:23</nova:creationTime>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:04:24 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:04:24 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:owner>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:04:24 user nova-compute[74319]:       </nova:owner>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:04:24 user nova-compute[74319]:       <nova:ports>
Oct 30 14:04:24 user nova-compute[74319]:         <nova:port uuid="b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9">
Oct 30 14:04:24 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:04:24 user nova-compute[74319]:         </nova:port>
Oct 30 14:04:24 user nova-compute[74319]:       </nova:ports>
Oct 30 14:04:24 user nova-compute[74319]:     </nova:instance>
Oct 30 14:04:24 user nova-compute[74319]:   </metadata>
Oct 30 14:04:24 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:04:24 user nova-compute[74319]:     <system>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="serial">3fb6cc13-e069-46bc-9b0b-50fe57103fd5</entry>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="uuid">3fb6cc13-e069-46bc-9b0b-50fe57103fd5</entry>
Oct 30 14:04:24 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:04:24 user nova-compute[74319]:     </system>
Oct 30 14:04:24 user nova-compute[74319]:   </sysinfo>
Oct 30 14:04:24 user nova-compute[74319]:   <os>
Oct 30 14:04:24 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:04:24 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:04:24 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:04:24 user nova-compute[74319]:   </os>
Oct 30 14:04:24 user nova-compute[74319]:   <features>
Oct 30 14:04:24 user nova-compute[74319]:     <acpi/>
Oct 30 14:04:24 user nova-compute[74319]:     <apic/>
Oct 30 14:04:24 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:04:24 user nova-compute[74319]:   </features>
Oct 30 14:04:24 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:04:24 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:04:24 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:04:24 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:04:24 user nova-compute[74319]:   </clock>
Oct 30 14:04:24 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:04:24 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:04:24 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:04:24 user nova-compute[74319]:   </cpu>
Oct 30 14:04:24 user nova-compute[74319]:   <devices>
Oct 30 14:04:24 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:04:24 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:04:24 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:04:24 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:04:24 user nova-compute[74319]:       <serial>4af4e65e-97af-4a89-b347-79e53e94f14f</serial>
Oct 30 14:04:24 user nova-compute[74319]:     </disk>
Oct 30 14:04:24 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:04:24 user nova-compute[74319]:       <mac address="fa:16:3e:c1:b4:48"/>
Oct 30 14:04:24 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:04:24 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:04:24 user nova-compute[74319]:       <target dev="tapb6c1c1c5-d0"/>
Oct 30 14:04:24 user nova-compute[74319]:     </interface>
Oct 30 14:04:24 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:04:24 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/console.log" append="off"/>
Oct 30 14:04:24 user nova-compute[74319]:     </serial>
Oct 30 14:04:24 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:04:24 user nova-compute[74319]:     <video>
Oct 30 14:04:24 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:04:24 user nova-compute[74319]:     </video>
Oct 30 14:04:24 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:04:24 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:04:24 user nova-compute[74319]:     </rng>
Oct 30 14:04:24 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:04:24 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:04:24 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:04:24 user nova-compute[74319]:     </memballoon>
Oct 30 14:04:24 user nova-compute[74319]:   </devices>
Oct 30 14:04:24 user nova-compute[74319]: </domain>
Oct 30 14:04:24 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1439463144',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1439463144',id=20,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-jx544glu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:03:56Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=3fb6cc13-e069-46bc-9b0b-50fe57103fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG os_vif [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d164299-849e-5a51-9a1d-f4102b599911', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6c1c1c5-d0, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6c1c1c5-d0, col_values=(('qos', UUID('78122110-d326-45da-8118-8247b888eb39')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6c1c1c5-d0, col_values=(('external_ids', {'iface-id': 'b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:b4:48', 'vm-uuid': '3fb6cc13-e069-46bc-9b0b-50fe57103fd5'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:24 user nova-compute[74319]: INFO os_vif [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0')
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:c1:b4:48, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:28 user nova-compute[74319]: WARNING nova.compute.manager [req-58d73a52-8f40-4dc2-80ed-5d88b356c0f0 req-8752c6de-c8e5-4812-8873-60ec37a3f5ec service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state building and task_state spawning.
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:04:28 user nova-compute[74319]: WARNING nova.compute.manager [req-8d80d8dd-b4cb-4e0d-a24d-dd7147b6fb73 req-99273d57-cc55-4204-a24d-bb2b831b38c8 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state building and task_state spawning.
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:04:28 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:28 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8130MB free_disk=25.53940200805664GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance spawned successfully.
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:04:29 user nova-compute[74319]: INFO nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2737c88d-9a65-49c1-9ba6-988e3434b99d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:04:29 user nova-compute[74319]: INFO nova.compute.manager [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Took 34.00 seconds to build instance.
Oct 30 14:04:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0c1cf9d8-3b81-46ae-8f42-f9ae152ff37a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.120s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:04:32 user nova-compute[74319]: INFO nova.compute.manager [None req-6ff83af1-668e-4246-9139-401d336ec0f6 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Get console output
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:32 user nova-compute[74319]: INFO nova.compute.manager [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Terminating instance
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] During wait destroy, instance disappeared. {{(pid=74319) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 30 14:04:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Instance destroyed successfully.
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.objects.instance [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lazy-loading 'resources' on Instance uuid 67280b94-8d8c-47ce-800d-a88d7de8e3d3 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T13:55:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1279271681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1904580473',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZamBmUkUghkSL/oO2f7Dmvtu1DvtJs7O6EIiD+2htZ6cPI2j/H+wmBiWZod4ZFO/LHmgTlAL0JbCLWEshjXSJ4gRIVx4HKrU3cNmOkCr+z/W8UAkgM6yxYqbgXZNSCgw==',key_name='tempest-keypair-1468331112',keypairs=<?>,launch_index=0,launched_at=2023-10-30T13:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='a57ddfde4dc84a5ba386188705391e4d',ramdisk_id='',reservation_id='r-5sca1jmd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1977745252',owner_user_name='tempest-ServerActionsV293TestJSON-1977745252-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:00:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2eed42254fc948d7a606fe240672ec01',uuid=67280b94-8d8c-47ce-800d-a88d7de8e3d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converting VIF {"id": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "address": "fa:16:3e:66:da:a1", "network": {"id": "ae02f9b1-f4ad-4459-8644-9e4289af29bc", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-528641771-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a57ddfde4dc84a5ba386188705391e4d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24cf35b1-7e", "ovs_interfaceid": "24cf35b1-7eee-4873-b57a-8a04d0f7377e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_vif [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24cf35b1-7e, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:04:32 user nova-compute[74319]: INFO os_vif [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:da:a1,bridge_name='br-int',has_traffic_filtering=True,id=24cf35b1-7eee-4873-b57a-8a04d0f7377e,network=Network(ae02f9b1-f4ad-4459-8644-9e4289af29bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24cf35b1-7e')
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'STzpahxi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:32 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[258f18e8-9022-4a18-8a2f-e1a70f14a697]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:04:32 user nova-compute[74319]: No targets found.
Oct 30 14:04:32 user nova-compute[74319]: iSNS:
Oct 30 14:04:32 user nova-compute[74319]: No targets found.
Oct 30 14:04:32 user nova-compute[74319]: STATIC:
Oct 30 14:04:32 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:04:32 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:04:32 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:04:32 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934
Oct 30 14:04:32 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:04:32 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:04:32 user nova-compute[74319]: FIRMWARE:
Oct 30 14:04:32 user nova-compute[74319]: No targets found.
Oct 30 14:04:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:04:32 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:04:32 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05e121ec-970e-4e6a-8701-36f0febdac05', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[433bc1c2-ae45-4550-af32-96feccefe4ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae509736-66ed-4a83-addf-22a93a501a89]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:32 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:32 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998675090>, {}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Disconnecting from: [] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.088s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] <== disconnect_volume: return (90ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:04:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Deletion of /opt/stack/data/nova/instances/67280b94-8d8c-47ce-800d-a88d7de8e3d3_del complete
Oct 30 14:04:32 user nova-compute[74319]: INFO nova.compute.manager [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Took 0.23 seconds to destroy the instance on the hypervisor.
Oct 30 14:04:32 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:04:32 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:04:33 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:33 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Took 1.04 seconds to deallocate network for instance.
Oct 30 14:04:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-7e748361-6b84-4707-a1ca-b8acf503e464 req-33c4f599-81ff-4b4b-a7ca-b97a419e00f0 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Received event network-vif-deleted-24cf35b1-7eee-4873-b57a-8a04d0f7377e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:04:33 user nova-compute[74319]: INFO nova.compute.manager [req-7e748361-6b84-4707-a1ca-b8acf503e464 req-33c4f599-81ff-4b4b-a7ca-b97a419e00f0 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Neutron deleted interface 24cf35b1-7eee-4873-b57a-8a04d0f7377e; detaching it from the instance and deleting it from the info cache
Oct 30 14:04:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-7e748361-6b84-4707-a1ca-b8acf503e464 req-33c4f599-81ff-4b4b-a7ca-b97a419e00f0 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:04:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-7e748361-6b84-4707-a1ca-b8acf503e464 req-33c4f599-81ff-4b4b-a7ca-b97a419e00f0 service nova] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Detach interface failed, port_id=24cf35b1-7eee-4873-b57a-8a04d0f7377e, reason: Instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:04:33 user nova-compute[74319]: INFO nova.compute.manager [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Took 0.11 seconds to detach 1 volumes for instance.
Oct 30 14:04:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] [instance: 67280b94-8d8c-47ce-800d-a88d7de8e3d3] Deleting volume: 05e121ec-970e-4e6a-8701-36f0febdac05 {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:04:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:04:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:04:34 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:04:34 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:04:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:34 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Deleted allocations for instance 67280b94-8d8c-47ce-800d-a88d7de8e3d3
Oct 30 14:04:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-80d95f15-317f-43fb-b480-a94ea37fd201 tempest-ServerActionsV293TestJSON-1977745252 tempest-ServerActionsV293TestJSON-1977745252-project-member] Lock "67280b94-8d8c-47ce-800d-a88d7de8e3d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2737c88d-9a65-49c1-9ba6-988e3434b99d is timed out.
Oct 30 14:04:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance 2737c88d-9a65-49c1-9ba6-988e3434b99d from the live domain config.
Oct 30 14:04:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VToPpyCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:04:40 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca63503-bf52-40e4-9cbe-123c99e06b4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:04:40 user nova-compute[74319]: No targets found.
Oct 30 14:04:40 user nova-compute[74319]: iSNS:
Oct 30 14:04:40 user nova-compute[74319]: No targets found.
Oct 30 14:04:40 user nova-compute[74319]: STATIC:
Oct 30 14:04:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:04:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:04:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:04:40 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934
Oct 30 14:04:40 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:04:40 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:04:40 user nova-compute[74319]: FIRMWARE:
Oct 30 14:04:40 user nova-compute[74319]: No targets found.
Oct 30 14:04:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:04:40 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:04:40 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ce164-a55c-4909-9200-e114bb1cf8b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe33d9f-0d51-4e40-8327-0ce5c1c518bd]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:40 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 (non-flash)
Oct 30 14:04:40 user nova-compute[74319]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:04:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a017dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9b9dbe-5b04-4257-836b-4f524e573ebf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b9703a-da66-4aa4-9416-0dcf755cb9a4]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7517d04a-5810-413f-b424-4082560834f1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ca7bb-e32d-42ca-b7c0-1c2fa7e8e040]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d83ac-7698-469f-85bf-6b47bb292c8d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adefa0d-0b86-4835-ad66-4c9bf2b1ff25]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260]
Oct 30 14:04:40 user nova-compute[74319]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934, portal: 172.16.0.220,3260] successful.
Oct 30 14:04:40 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09e7fa67-792c-41ae-b2ab-6dfa4d8d9934 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4725b5fd-5528-46fe-93e4-a899d8bb227a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== disconnect_volume: return (280ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:04:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:04:42 user nova-compute[74319]: DEBUG nova.objects.instance [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:04:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd06a423-0168-418f-804d-6b06f7d2f513 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.569s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:04:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:04:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:09 user nova-compute[74319]: INFO nova.compute.manager [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Terminating instance
Oct 30 14:05:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-unplugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] No waiting events found dispatching network-vif-unplugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e174ab1-9017-4fb4-b11b-41f6dd4a5069 req-fd71f4fa-c17c-4135-98ab-86ba4afd19d2 service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-unplugged-7be24740-a682-4688-9c44-14ae3b084a09 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:05:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Instance destroyed successfully.
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.objects.instance [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'resources' on Instance uuid 2737c88d-9a65-49c1-9ba6-988e3434b99d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:01:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-682710485',display_name='tempest-AttachVolumeNegativeTest-server-682710485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-682710485',id=18,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrOcWxRvGT/cdzYbECQWaaFbbxbE7DoXt8fZSBaJuxX1Y67fDztIeFxFcZzBBpnsV9FYjMfzg6vkW/AmHdclNzWhEWMuNMPQP19S2dEzGsdIcvdy2Vky3MtWMILEblEsQ==',key_name='tempest-keypair-105813618',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:02:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-krhwzx3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=2737c88d-9a65-49c1-9ba6-988e3434b99d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "7be24740-a682-4688-9c44-14ae3b084a09", "address": "fa:16:3e:b6:3c:8f", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be24740-a6", "ovs_interfaceid": "7be24740-a682-4688-9c44-14ae3b084a09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG os_vif [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be24740-a6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c8e517e-8fec-4b40-89eb-d4313ff26177) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:10 user nova-compute[74319]: INFO os_vif [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:3c:8f,bridge_name='br-int',has_traffic_filtering=True,id=7be24740-a682-4688-9c44-14ae3b084a09,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be24740-a6')
Oct 30 14:05:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Deleting instance files /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d_del
Oct 30 14:05:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Deletion of /opt/stack/data/nova/instances/2737c88d-9a65-49c1-9ba6-988e3434b99d_del complete
Oct 30 14:05:10 user nova-compute[74319]: INFO nova.compute.manager [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 30 14:05:10 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:05:10 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:12 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Took 1.23 seconds to deallocate network for instance.
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-f30724ba-8e7d-4cbe-9a45-6798ef8c8b7a req-84c64c56-6d11-4d39-afc1-ee16f12fd03d service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-deleted-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] Acquiring lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] No waiting events found dispatching network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:12 user nova-compute[74319]: WARNING nova.compute.manager [req-20849779-18a5-4069-8ca1-22fef3fe1b84 req-c40c1ec2-f095-43bc-8045-0c710f9d3c0e service nova] [instance: 2737c88d-9a65-49c1-9ba6-988e3434b99d] Received unexpected event network-vif-plugged-7be24740-a682-4688-9c44-14ae3b084a09 for instance with vm_state deleted and task_state None.
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.191s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:05:12 user nova-compute[74319]: INFO nova.compute.claims [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Claim successful on node user
Oct 30 14:05:12 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Deleted allocations for instance 2737c88d-9a65-49c1-9ba6-988e3434b99d
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-42a5ddd8-056f-40bb-b529-2cc04959f271 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "2737c88d-9a65-49c1-9ba6-988e3434b99d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.803s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:05:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:05:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Creating image(s)
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "/opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "/opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "/opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.policy [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03249afd9f4c4505b53fd6df9b16653d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d8eae6f9ab46278bc61a8aa3a1ce83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk 1073741824" returned: 0 in 0.056s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.217s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Checking if we can resize image /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:05:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Cannot resize image /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Ensure instance console log exists: /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Successfully created port: 5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Successfully updated port: 5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquired lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-changed-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Refreshing instance network info cache due to event network-changed-5c68026a-5c79-432d-8702-0db2f8f5d369. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] Acquiring lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Updating instance_info_cache with network_info: [{"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Releasing lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Instance network_info: |[{"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] Acquired lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Refreshing network info cache for port 5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Start _get_guest_xml network_info=[{"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:05:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:15 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2121408991',display_name='tempest-VolumesNegativeTest-instance-2121408991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2121408991',id=22,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0d8eae6f9ab46278bc61a8aa3a1ce83',ramdisk_id='',reservation_id='r-12w55mqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1849580014',owner_user_name='tempest-VolumesNegativeTest-1849580014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:13Z,user_data=None,user_id='03249afd9f4c4505b53fd6df9b16653d',uuid=12d30eed-d927-4fc9-bf54-fe9fb986b140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converting VIF {"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.objects.instance [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lazy-loading 'pci_devices' on Instance uuid 12d30eed-d927-4fc9-bf54-fe9fb986b140 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:05:15 user nova-compute[74319]:   <uuid>12d30eed-d927-4fc9-bf54-fe9fb986b140</uuid>
Oct 30 14:05:15 user nova-compute[74319]:   <name>instance-00000016</name>
Oct 30 14:05:15 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:05:15 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:05:15 user nova-compute[74319]:   <metadata>
Oct 30 14:05:15 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:05:15 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:name>tempest-VolumesNegativeTest-instance-2121408991</nova:name>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:05:15</nova:creationTime>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:05:15 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:05:15 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:owner>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:user uuid="03249afd9f4c4505b53fd6df9b16653d">tempest-VolumesNegativeTest-1849580014-project-member</nova:user>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:project uuid="b0d8eae6f9ab46278bc61a8aa3a1ce83">tempest-VolumesNegativeTest-1849580014</nova:project>
Oct 30 14:05:15 user nova-compute[74319]:       </nova:owner>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:05:15 user nova-compute[74319]:       <nova:ports>
Oct 30 14:05:15 user nova-compute[74319]:         <nova:port uuid="5c68026a-5c79-432d-8702-0db2f8f5d369">
Oct 30 14:05:15 user nova-compute[74319]:           <nova:ip type="fixed" address="192.168.233.50" ipVersion="4"/>
Oct 30 14:05:15 user nova-compute[74319]:         </nova:port>
Oct 30 14:05:15 user nova-compute[74319]:       </nova:ports>
Oct 30 14:05:15 user nova-compute[74319]:     </nova:instance>
Oct 30 14:05:15 user nova-compute[74319]:   </metadata>
Oct 30 14:05:15 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:05:15 user nova-compute[74319]:     <system>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="serial">12d30eed-d927-4fc9-bf54-fe9fb986b140</entry>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="uuid">12d30eed-d927-4fc9-bf54-fe9fb986b140</entry>
Oct 30 14:05:15 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:05:15 user nova-compute[74319]:     </system>
Oct 30 14:05:15 user nova-compute[74319]:   </sysinfo>
Oct 30 14:05:15 user nova-compute[74319]:   <os>
Oct 30 14:05:15 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:05:15 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:05:15 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:05:15 user nova-compute[74319]:   </os>
Oct 30 14:05:15 user nova-compute[74319]:   <features>
Oct 30 14:05:15 user nova-compute[74319]:     <acpi/>
Oct 30 14:05:15 user nova-compute[74319]:     <apic/>
Oct 30 14:05:15 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:05:15 user nova-compute[74319]:   </features>
Oct 30 14:05:15 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:05:15 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:05:15 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:05:15 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:05:15 user nova-compute[74319]:   </clock>
Oct 30 14:05:15 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:05:15 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:05:15 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:05:15 user nova-compute[74319]:   </cpu>
Oct 30 14:05:15 user nova-compute[74319]:   <devices>
Oct 30 14:05:15 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:05:15 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:05:15 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk"/>
Oct 30 14:05:15 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:05:15 user nova-compute[74319]:     </disk>
Oct 30 14:05:15 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:05:15 user nova-compute[74319]:       <mac address="fa:16:3e:0a:86:39"/>
Oct 30 14:05:15 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:15 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:05:15 user nova-compute[74319]:       <target dev="tap5c68026a-5c"/>
Oct 30 14:05:15 user nova-compute[74319]:     </interface>
Oct 30 14:05:15 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:05:15 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/console.log" append="off"/>
Oct 30 14:05:15 user nova-compute[74319]:     </serial>
Oct 30 14:05:15 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:05:15 user nova-compute[74319]:     <video>
Oct 30 14:05:15 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:15 user nova-compute[74319]:     </video>
Oct 30 14:05:15 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:05:15 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:05:15 user nova-compute[74319]:     </rng>
Oct 30 14:05:15 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:05:15 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:05:15 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:05:15 user nova-compute[74319]:     </memballoon>
Oct 30 14:05:15 user nova-compute[74319]:   </devices>
Oct 30 14:05:15 user nova-compute[74319]: </domain>
Oct 30 14:05:15 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2121408991',display_name='tempest-VolumesNegativeTest-instance-2121408991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2121408991',id=22,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0d8eae6f9ab46278bc61a8aa3a1ce83',ramdisk_id='',reservation_id='r-12w55mqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1849580014',owner_user_name='tempest-VolumesNegativeTest-1849580014-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:13Z,user_data=None,user_id='03249afd9f4c4505b53fd6df9b16653d',uuid=12d30eed-d927-4fc9-bf54-fe9fb986b140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converting VIF {"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG os_vif [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '303d89a1-4ad8-5e39-85bf-95ee4cf5fe92', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c68026a-5c, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c68026a-5c, col_values=(('qos', UUID('f432ad69-d511-487d-a364-79cab0a30bc9')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c68026a-5c, col_values=(('external_ids', {'iface-id': '5c68026a-5c79-432d-8702-0db2f8f5d369', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:86:39', 'vm-uuid': '12d30eed-d927-4fc9-bf54-fe9fb986b140'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:15 user nova-compute[74319]: INFO os_vif [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c')
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] No VIF found with MAC fa:16:3e:0a:86:39, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Updated VIF entry in instance network info cache for port 5c68026a-5c79-432d-8702-0db2f8f5d369. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Updating instance_info_cache with network_info: [{"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ce5ed0ed-5483-4bd6-b539-e7b0d2a9f540 req-097d47fb-46ea-40e3-8d7b-28fcee1a1ec5 service nova] Releasing lock "refresh_cache-12d30eed-d927-4fc9-bf54-fe9fb986b140" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] No waiting events found dispatching network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:17 user nova-compute[74319]: WARNING nova.compute.manager [req-9aab214e-2327-4090-9884-f342ffc7abe5 req-66d74187-945d-4338-8f39-bee640a65ca0 service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received unexpected event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 for instance with vm_state building and task_state spawning.
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:05:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Instance spawned successfully.
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:19 user nova-compute[74319]: INFO nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Took 6.05 seconds to spawn the instance on the hypervisor.
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] No waiting events found dispatching network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:19 user nova-compute[74319]: WARNING nova.compute.manager [req-a63df9c7-b416-45b2-8229-5432556d8b83 req-f653e0c0-c237-4a6d-a7d4-755d9015feeb service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received unexpected event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 for instance with vm_state building and task_state spawning.
Oct 30 14:05:19 user nova-compute[74319]: INFO nova.compute.manager [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Took 7.07 seconds to build instance.
Oct 30 14:05:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-def2c8b5-13e0-4e85-a646-46cb95e4012f tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.175s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing instance network info cache due to event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG nova.network.neutron [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG nova.network.neutron [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updated VIF entry in instance network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG nova.network.neutron [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-90f3fb93-2824-4972-9892-a7db61baa25b req-e08e6a09-2528-4434-aed7-219aa5a6f5d8 service nova] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:22 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:22 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:05:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:23 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:25 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:27 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:27 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8094MB free_disk=25.525550842285156GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 12d30eed-d927-4fc9-bf54-fe9fb986b140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:05:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:29 user nova-compute[74319]: INFO nova.compute.manager [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Shelving
Oct 30 14:05:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance destroyed successfully.
Oct 30 14:05:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Beginning cold snapshot process
Oct 30 14:05:30 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:05:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk /opt/stack/data/nova/instances/snapshots/tmpu_rjacp9/c25b51e64a49414aafa58fa7d45d1aba {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk /opt/stack/data/nova/instances/snapshots/tmpu_rjacp9/c25b51e64a49414aafa58fa7d45d1aba" returned: 0 in 0.529s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Snapshot extracted, beginning image upload
Oct 30 14:05:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:34 user nova-compute[74319]: WARNING nova.compute.manager [req-1f486356-439b-4eba-bf1c-52c912be7bd8 req-7ec146a2-d082-485e-baca-58bac0b005d3 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state active and task_state shelving_image_uploading.
Oct 30 14:05:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Snapshot image upload complete
Oct 30 14:05:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:34 user nova-compute[74319]: INFO nova.compute.manager [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Shelve offloading
Oct 30 14:05:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance destroyed successfully.
Oct 30 14:05:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance destroyed successfully.
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'resources' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhnZsHN9yo6cWW7C3RXnaqTKtPxxMABjJ7Zf2j+Pt8HBXRqzqEHxAwf+igL3OWSUOKSZkHY8zq+H5wuv8nC2wg07izK4tJ8LKlG8O2/jrOhi06bvLBtPcwt8KKzSFD7dA==',key_name='tempest-keypair-1275219634',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:05:34.390011',shelved_host='user',shelved_image_id='fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG os_vif [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d45c22-12, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing instance network info cache due to event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.network.neutron [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bdcf7a03-a423-438a-b4d8-bb3aac3e7459) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:35 user nova-compute[74319]: INFO os_vif [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12')
Oct 30 14:05:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Deleting instance files /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2_del
Oct 30 14:05:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Deletion of /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2_del complete
Oct 30 14:05:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:05:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:36 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Deleted allocations for instance 00bf4369-a4dd-463a-ac55-12625d0a81a2
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'numa_topology' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.objects.base [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<00bf4369-a4dd-463a-ac55-12625d0a81a2> lazy-loaded attributes: resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:36 user nova-compute[74319]: WARNING nova.compute.manager [req-4702aaa8-7df1-4d2c-b90e-2c1abe5d1a1b req-178a9e8b-3d6d-44a7-b50c-af3111d95ac2 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state shelved_offloaded and task_state None.
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e80b133a-b3d2-4123-b407-0653bbdfa4f7 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.738s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.network.neutron [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updated VIF entry in instance network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG nova.network.neutron [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd4d45c22-12", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a8d992c-4418-4f21-b4c6-3ef914d15040 req-b2cca178-3a31-4402-9c86-4256acfcf7ba service nova] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:39 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:05:39 user nova-compute[74319]: INFO nova.compute.claims [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Claim successful on node user
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:05:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.policy [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4881f45201f94726bcf3cf5065c8afae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d27a717598b4f839ad4a9c12073b240', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:05:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Creating image(s)
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:05:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.284s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:05:41 user nova-compute[74319]: INFO nova.compute.claims [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Claim successful on node user
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk 1073741824" returned: 0 in 0.074s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Successfully created port: 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Cannot resize image /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Ensure instance console log exists: /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.753s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:05:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:05:41 user nova-compute[74319]: INFO nova.compute.claims [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Claim successful on node user
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:05:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Creating image(s)
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "/opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "/opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.policy [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1f3abf29ecb4ea8a86da936a555e164', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc2f5e6e78694039ba6257f66fc7af85', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk 1073741824" returned: 0 in 0.058s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:05:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Successfully updated port: 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.policy [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '521f59eb12f844b49a6a727ec38bd016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42370e22b20540a6b4670bfcc02d62b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing instance network info cache due to event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:05:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Creating image(s)
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Cannot resize image /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Ensure instance console log exists: /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Successfully created port: da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance network_info: |[{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start _get_guest_xml network_info=[{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk 1073741824" returned: 0 in 0.064s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Successfully created port: c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:05:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586366234',display_name='tempest-ServerStableDeviceRescueTest-server-1586366234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586366234',id=23,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF507esoFzABrF72jsRukC2boVMp8hRTOhy8lzHqOUHI5qTLXU6bWt+8rqLzhikXkJtMS+VqXwM+/a7Wt8R0Oj0oj4Kbc/K6uYSVfAVJb0Zfvk/KAVZkLwNTYhYHvezfdg==',key_name='tempest-keypair-2014099519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d27a717598b4f839ad4a9c12073b240',ramdisk_id='',reservation_id='r-0mg360fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-428345104',owner_user_name='tempest-ServerStableDeviceRescueTest-428345104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4881f45201f94726bcf3cf5065c8afae',uuid=8a3f3e7c-2080-42c0-adf0-44e7734782a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converting VIF {"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:05:43 user nova-compute[74319]:   <uuid>8a3f3e7c-2080-42c0-adf0-44e7734782a4</uuid>
Oct 30 14:05:43 user nova-compute[74319]:   <name>instance-00000017</name>
Oct 30 14:05:43 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:05:43 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:05:43 user nova-compute[74319]:   <metadata>
Oct 30 14:05:43 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:05:43 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1586366234</nova:name>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:05:43</nova:creationTime>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:05:43 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:05:43 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:owner>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:user uuid="4881f45201f94726bcf3cf5065c8afae">tempest-ServerStableDeviceRescueTest-428345104-project-member</nova:user>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:project uuid="9d27a717598b4f839ad4a9c12073b240">tempest-ServerStableDeviceRescueTest-428345104</nova:project>
Oct 30 14:05:43 user nova-compute[74319]:       </nova:owner>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:05:43 user nova-compute[74319]:       <nova:ports>
Oct 30 14:05:43 user nova-compute[74319]:         <nova:port uuid="6130e6dd-5c0f-4e59-a446-eba9c5ab6ade">
Oct 30 14:05:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 14:05:43 user nova-compute[74319]:         </nova:port>
Oct 30 14:05:43 user nova-compute[74319]:       </nova:ports>
Oct 30 14:05:43 user nova-compute[74319]:     </nova:instance>
Oct 30 14:05:43 user nova-compute[74319]:   </metadata>
Oct 30 14:05:43 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:05:43 user nova-compute[74319]:     <system>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="serial">8a3f3e7c-2080-42c0-adf0-44e7734782a4</entry>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="uuid">8a3f3e7c-2080-42c0-adf0-44e7734782a4</entry>
Oct 30 14:05:43 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:05:43 user nova-compute[74319]:     </system>
Oct 30 14:05:43 user nova-compute[74319]:   </sysinfo>
Oct 30 14:05:43 user nova-compute[74319]:   <os>
Oct 30 14:05:43 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:05:43 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:05:43 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:05:43 user nova-compute[74319]:   </os>
Oct 30 14:05:43 user nova-compute[74319]:   <features>
Oct 30 14:05:43 user nova-compute[74319]:     <acpi/>
Oct 30 14:05:43 user nova-compute[74319]:     <apic/>
Oct 30 14:05:43 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:05:43 user nova-compute[74319]:   </features>
Oct 30 14:05:43 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:05:43 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:05:43 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:05:43 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:05:43 user nova-compute[74319]:   </clock>
Oct 30 14:05:43 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:05:43 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:05:43 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:05:43 user nova-compute[74319]:   </cpu>
Oct 30 14:05:43 user nova-compute[74319]:   <devices>
Oct 30 14:05:43 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:05:43 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:05:43 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk"/>
Oct 30 14:05:43 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:05:43 user nova-compute[74319]:     </disk>
Oct 30 14:05:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:05:43 user nova-compute[74319]:       <mac address="fa:16:3e:de:a1:bd"/>
Oct 30 14:05:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:05:43 user nova-compute[74319]:       <target dev="tap6130e6dd-5c"/>
Oct 30 14:05:43 user nova-compute[74319]:     </interface>
Oct 30 14:05:43 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:05:43 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/console.log" append="off"/>
Oct 30 14:05:43 user nova-compute[74319]:     </serial>
Oct 30 14:05:43 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:05:43 user nova-compute[74319]:     <video>
Oct 30 14:05:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:43 user nova-compute[74319]:     </video>
Oct 30 14:05:43 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:05:43 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:05:43 user nova-compute[74319]:     </rng>
Oct 30 14:05:43 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:05:43 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:05:43 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:05:43 user nova-compute[74319]:     </memballoon>
Oct 30 14:05:43 user nova-compute[74319]:   </devices>
Oct 30 14:05:43 user nova-compute[74319]: </domain>
Oct 30 14:05:43 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586366234',display_name='tempest-ServerStableDeviceRescueTest-server-1586366234',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586366234',id=23,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF507esoFzABrF72jsRukC2boVMp8hRTOhy8lzHqOUHI5qTLXU6bWt+8rqLzhikXkJtMS+VqXwM+/a7Wt8R0Oj0oj4Kbc/K6uYSVfAVJb0Zfvk/KAVZkLwNTYhYHvezfdg==',key_name='tempest-keypair-2014099519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d27a717598b4f839ad4a9c12073b240',ramdisk_id='',reservation_id='r-0mg360fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-428345104',owner_user_name='tempest-ServerStableDeviceRescueTest-428345104-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4881f45201f94726bcf3cf5065c8afae',uuid=8a3f3e7c-2080-42c0-adf0-44e7734782a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converting VIF {"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG os_vif [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e77510e-2947-54bd-96d7-c1e5fb6b7af0', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6130e6dd-5c, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6130e6dd-5c, col_values=(('qos', UUID('599218d0-f9d0-4742-96bc-1951af847817')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6130e6dd-5c, col_values=(('external_ids', {'iface-id': '6130e6dd-5c0f-4e59-a446-eba9c5ab6ade', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:a1:bd', 'vm-uuid': '8a3f3e7c-2080-42c0-adf0-44e7734782a4'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:43 user nova-compute[74319]: INFO os_vif [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c')
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No VIF found with MAC fa:16:3e:de:a1:bd, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Cannot resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Ensure instance console log exists: /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Successfully updated port: c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updated VIF entry in instance network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af05f26-c62a-4e41-8581-ba04772cf820 req-b7289252-33a4-491f-a8d5-4cdafad6104d service nova] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-changed-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Refreshing instance network info cache due to event network-changed-c83bbef5-d67d-4021-8153-e35b9019544e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Successfully updated port: da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquired lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance network_info: |[{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Refreshing network info cache for port c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start _get_guest_xml network_info=[{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:05:44 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:44 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'pci_devices' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:05:44 user nova-compute[74319]:   <uuid>43fe7c9d-5a25-455b-8245-6028034d44a9</uuid>
Oct 30 14:05:44 user nova-compute[74319]:   <name>instance-00000019</name>
Oct 30 14:05:44 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:05:44 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:05:44 user nova-compute[74319]:   <metadata>
Oct 30 14:05:44 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:05:44 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeTestJSON-server-447137083</nova:name>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:05:44</nova:creationTime>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:05:44 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:05:44 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:owner>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:user uuid="521f59eb12f844b49a6a727ec38bd016">tempest-AttachVolumeTestJSON-636845633-project-member</nova:user>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:project uuid="42370e22b20540a6b4670bfcc02d62b6">tempest-AttachVolumeTestJSON-636845633</nova:project>
Oct 30 14:05:44 user nova-compute[74319]:       </nova:owner>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:05:44 user nova-compute[74319]:       <nova:ports>
Oct 30 14:05:44 user nova-compute[74319]:         <nova:port uuid="c83bbef5-d67d-4021-8153-e35b9019544e">
Oct 30 14:05:44 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:05:44 user nova-compute[74319]:         </nova:port>
Oct 30 14:05:44 user nova-compute[74319]:       </nova:ports>
Oct 30 14:05:44 user nova-compute[74319]:     </nova:instance>
Oct 30 14:05:44 user nova-compute[74319]:   </metadata>
Oct 30 14:05:44 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:05:44 user nova-compute[74319]:     <system>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="serial">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="uuid">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:05:44 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:05:44 user nova-compute[74319]:     </system>
Oct 30 14:05:44 user nova-compute[74319]:   </sysinfo>
Oct 30 14:05:44 user nova-compute[74319]:   <os>
Oct 30 14:05:44 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:05:44 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:05:44 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:05:44 user nova-compute[74319]:   </os>
Oct 30 14:05:44 user nova-compute[74319]:   <features>
Oct 30 14:05:44 user nova-compute[74319]:     <acpi/>
Oct 30 14:05:44 user nova-compute[74319]:     <apic/>
Oct 30 14:05:44 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:05:44 user nova-compute[74319]:   </features>
Oct 30 14:05:44 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:05:44 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:05:44 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:05:44 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:05:44 user nova-compute[74319]:   </clock>
Oct 30 14:05:44 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:05:44 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:05:44 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:05:44 user nova-compute[74319]:   </cpu>
Oct 30 14:05:44 user nova-compute[74319]:   <devices>
Oct 30 14:05:44 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:05:44 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:05:44 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk"/>
Oct 30 14:05:44 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:05:44 user nova-compute[74319]:     </disk>
Oct 30 14:05:44 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:05:44 user nova-compute[74319]:       <mac address="fa:16:3e:1e:90:5f"/>
Oct 30 14:05:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:44 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:05:44 user nova-compute[74319]:       <target dev="tapc83bbef5-d6"/>
Oct 30 14:05:44 user nova-compute[74319]:     </interface>
Oct 30 14:05:44 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:05:44 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/console.log" append="off"/>
Oct 30 14:05:44 user nova-compute[74319]:     </serial>
Oct 30 14:05:44 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:05:44 user nova-compute[74319]:     <video>
Oct 30 14:05:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:44 user nova-compute[74319]:     </video>
Oct 30 14:05:44 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:05:44 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:05:44 user nova-compute[74319]:     </rng>
Oct 30 14:05:44 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:05:44 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:05:44 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:05:44 user nova-compute[74319]:     </memballoon>
Oct 30 14:05:44 user nova-compute[74319]:   </devices>
Oct 30 14:05:44 user nova-compute[74319]: </domain>
Oct 30 14:05:44 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG os_vif [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3d476c-66a5-53c5-920b-03bf2e5c0ad7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83bbef5-d6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc83bbef5-d6, col_values=(('qos', UUID('6409b271-28b2-41fa-98df-b818079f48a0')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc83bbef5-d6, col_values=(('external_ids', {'iface-id': 'c83bbef5-d67d-4021-8153-e35b9019544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:90:5f', 'vm-uuid': '43fe7c9d-5a25-455b-8245-6028034d44a9'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: INFO os_vif [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No VIF found with MAC fa:16:3e:1e:90:5f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-changed-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Refreshing instance network info cache due to event network-changed-da3bbafe-404d-4006-9170-5b0f56485e8b. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] Acquiring lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating instance_info_cache with network_info: [{"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Releasing lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Instance network_info: |[{"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] Acquired lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Refreshing network info cache for port da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Start _get_guest_xml network_info=[{"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:44 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:05:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-934157020',display_name='tempest-TestServerVolumeAttachmentScenario-server-934157020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-934157020',id=24,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lEqW3hVrCvucqOqrtNMApQ6cbEvFwTJUpSjmjz90uaC9WBz7tyUHspPwvXiU8EyMm6OZSFkQEXYDnZNl/sRvxeyx50CBpzEBkHsfXxQUehxgKH7LwZRLPc0I34pl20w==',key_name='tempest-keypair-1123506176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2f5e6e78694039ba6257f66fc7af85',ramdisk_id='',reservation_id='r-smh27rnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-525935652',owner_user_name='tempest-TestServerVolumeAttachmentScenario-525935652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1f3abf29ecb4ea8a86da936a555e164',uuid=8c7acd12-fe23-479d-9ef2-5f4341b13267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converting VIF {"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updated VIF entry in instance network info cache for port c83bbef5-d67d-4021-8153-e35b9019544e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:05:45 user nova-compute[74319]:   <uuid>8c7acd12-fe23-479d-9ef2-5f4341b13267</uuid>
Oct 30 14:05:45 user nova-compute[74319]:   <name>instance-00000018</name>
Oct 30 14:05:45 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:05:45 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:05:45 user nova-compute[74319]:   <metadata>
Oct 30 14:05:45 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:05:45 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-934157020</nova:name>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:05:44</nova:creationTime>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:05:45 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:05:45 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:owner>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:user uuid="a1f3abf29ecb4ea8a86da936a555e164">tempest-TestServerVolumeAttachmentScenario-525935652-project-member</nova:user>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:project uuid="bc2f5e6e78694039ba6257f66fc7af85">tempest-TestServerVolumeAttachmentScenario-525935652</nova:project>
Oct 30 14:05:45 user nova-compute[74319]:       </nova:owner>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:05:45 user nova-compute[74319]:       <nova:ports>
Oct 30 14:05:45 user nova-compute[74319]:         <nova:port uuid="da3bbafe-404d-4006-9170-5b0f56485e8b">
Oct 30 14:05:45 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 14:05:45 user nova-compute[74319]:         </nova:port>
Oct 30 14:05:45 user nova-compute[74319]:       </nova:ports>
Oct 30 14:05:45 user nova-compute[74319]:     </nova:instance>
Oct 30 14:05:45 user nova-compute[74319]:   </metadata>
Oct 30 14:05:45 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:05:45 user nova-compute[74319]:     <system>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="serial">8c7acd12-fe23-479d-9ef2-5f4341b13267</entry>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="uuid">8c7acd12-fe23-479d-9ef2-5f4341b13267</entry>
Oct 30 14:05:45 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:05:45 user nova-compute[74319]:     </system>
Oct 30 14:05:45 user nova-compute[74319]:   </sysinfo>
Oct 30 14:05:45 user nova-compute[74319]:   <os>
Oct 30 14:05:45 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:05:45 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:05:45 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:05:45 user nova-compute[74319]:   </os>
Oct 30 14:05:45 user nova-compute[74319]:   <features>
Oct 30 14:05:45 user nova-compute[74319]:     <acpi/>
Oct 30 14:05:45 user nova-compute[74319]:     <apic/>
Oct 30 14:05:45 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:05:45 user nova-compute[74319]:   </features>
Oct 30 14:05:45 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:05:45 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:05:45 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:05:45 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:05:45 user nova-compute[74319]:   </clock>
Oct 30 14:05:45 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:05:45 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:05:45 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:05:45 user nova-compute[74319]:   </cpu>
Oct 30 14:05:45 user nova-compute[74319]:   <devices>
Oct 30 14:05:45 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:05:45 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:05:45 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk"/>
Oct 30 14:05:45 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:05:45 user nova-compute[74319]:     </disk>
Oct 30 14:05:45 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:05:45 user nova-compute[74319]:       <mac address="fa:16:3e:5a:45:a6"/>
Oct 30 14:05:45 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:45 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:05:45 user nova-compute[74319]:       <target dev="tapda3bbafe-40"/>
Oct 30 14:05:45 user nova-compute[74319]:     </interface>
Oct 30 14:05:45 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:05:45 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/console.log" append="off"/>
Oct 30 14:05:45 user nova-compute[74319]:     </serial>
Oct 30 14:05:45 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:05:45 user nova-compute[74319]:     <video>
Oct 30 14:05:45 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:45 user nova-compute[74319]:     </video>
Oct 30 14:05:45 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:05:45 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:05:45 user nova-compute[74319]:     </rng>
Oct 30 14:05:45 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:05:45 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:05:45 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:05:45 user nova-compute[74319]:     </memballoon>
Oct 30 14:05:45 user nova-compute[74319]:   </devices>
Oct 30 14:05:45 user nova-compute[74319]: </domain>
Oct 30 14:05:45 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-934157020',display_name='tempest-TestServerVolumeAttachmentScenario-server-934157020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-934157020',id=24,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lEqW3hVrCvucqOqrtNMApQ6cbEvFwTJUpSjmjz90uaC9WBz7tyUHspPwvXiU8EyMm6OZSFkQEXYDnZNl/sRvxeyx50CBpzEBkHsfXxQUehxgKH7LwZRLPc0I34pl20w==',key_name='tempest-keypair-1123506176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc2f5e6e78694039ba6257f66fc7af85',ramdisk_id='',reservation_id='r-smh27rnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-525935652',owner_user_name='tempest-TestServerVolumeAttachmentScenario-525935652-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:05:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1f3abf29ecb4ea8a86da936a555e164',uuid=8c7acd12-fe23-479d-9ef2-5f4341b13267,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converting VIF {"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG os_vif [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae491e0a-3319-5134-bacd-7fafcf9d4c79', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-510626f7-ac46-4756-8067-66e23f7255ed req-d5bd0883-54cb-4407-9d88-b26e419157da service nova] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda3bbafe-40, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda3bbafe-40, col_values=(('qos', UUID('2e048385-df9e-443f-8887-a82a765b7f1b')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda3bbafe-40, col_values=(('external_ids', {'iface-id': 'da3bbafe-404d-4006-9170-5b0f56485e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:45:a6', 'vm-uuid': '8c7acd12-fe23-479d-9ef2-5f4341b13267'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: INFO os_vif [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40')
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No VIF found with MAC fa:16:3e:5a:45:a6, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updated VIF entry in instance network info cache for port da3bbafe-404d-4006-9170-5b0f56485e8b. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating instance_info_cache with network_info: [{"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb78422a-812a-44e9-ae89-e605af12d665 req-b06700b8-6a0d-451c-b663-e4a0e60c53ac service nova] Releasing lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:45 user nova-compute[74319]: WARNING nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state building and task_state spawning.
Oct 30 14:05:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:46 user nova-compute[74319]: WARNING nova.compute.manager [req-c7ad5df9-4dfc-4efa-9d7c-29e3d50e2f47 req-cb2fe746-b990-49d7-b383-db3876b7a047 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state building and task_state spawning.
Oct 30 14:05:46 user nova-compute[74319]: INFO nova.compute.manager [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Rescuing
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance destroyed successfully.
Oct 30 14:05:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Attempting a stable device rescue
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:05:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Creating image(s)
Oct 30 14:05:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:48 user nova-compute[74319]: WARNING nova.compute.manager [req-64617785-6a78-4bba-8d78-5329088ca676 req-c96d2aeb-58ca-4970-9532-e54a620a7fdd service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state building and task_state spawning.
Oct 30 14:05:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] No waiting events found dispatching network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:48 user nova-compute[74319]: WARNING nova.compute.manager [req-b06d8fe3-d3a8-4b77-8d7d-e9cfc3b09d19 req-64738522-3ea5-4473-81b5-9cd070d3da6a service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received unexpected event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b for instance with vm_state building and task_state spawning.
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.part --force-share --output=json" returned: 0 in 0.217s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.images [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] 57be18d6-1151-47a6-9ee2-87efb804abd3 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.part /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.part /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.converted" returned: 0 in 0.528s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.911s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:05:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance spawned successfully.
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6 --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6,backing_fmt=raw /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6,backing_fmt=raw /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue" returned: 0 in 0.049s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "195f771ef75f645e9abf245eba0ef8fa0d4f0ae6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'migration_context' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<3fb6cc13-e069-46bc-9b0b-50fe57103fd5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start _get_guest_xml network_info=[{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:c1:b4:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '57be18d6-1151-47a6-9ee2-87efb804abd3', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'c8d90feb-ded0-4c2b-87fe-1837597d2682', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '3fb6cc13-e069-46bc-9b0b-50fe57103fd5', 'attached_at': '', 'detached_at': '', 'volume_id': '4af4e65e-97af-4a89-b347-79e53e94f14f', 'serial': '4af4e65e-97af-4a89-b347-79e53e94f14f'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:50 user nova-compute[74319]: INFO nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Took 9.61 seconds to spawn the instance on the hypervisor.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<3fb6cc13-e069-46bc-9b0b-50fe57103fd5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'numa_topology' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:50 user nova-compute[74319]: WARNING nova.compute.manager [req-52a54e31-3a13-4ac8-ad58-cbeddcecb907 req-1ea3a0a2-a515-4f66-81f1-1fbc98e3b7fb service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state building and task_state spawning.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<3fb6cc13-e069-46bc-9b0b-50fe57103fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<3fb6cc13-e069-46bc-9b0b-50fe57103fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:05:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:05:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:05:50 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: INFO nova.compute.manager [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Took 10.47 seconds to build instance.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[54547298-ea5a-49b0-959a-f23a191dbb91]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wrjeKdys\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 14:05:50 user nova-compute[74319]: node.name = iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:05:50 user nova-compute[74319]: node.tpgt = -1
Oct 30 14:05:50 user nova-compute[74319]: node.startup = automatic
Oct 30 14:05:50 user nova-compute[74319]: node.leading_login = No
Oct 30 14:05:50 user nova-compute[74319]: iface.iscsi_ifacename = default
Oct 30 14:05:50 user nova-compute[74319]: iface.net_ifacename = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.ipaddress = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.prefix_len = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.hwaddress = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.transport_name = tcp
Oct 30 14:05:50 user nova-compute[74319]: iface.initiatorname = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.vlan_id = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.vlan_priority = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.vlan_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.iface_num = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.mtu = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.port = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.bootproto = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.subnet_mask = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.gateway = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_alt_client_id = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_dns = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_learn_iqn = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_vendor_id_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_vendor_id = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.dhcp_slp_da = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.fragmentation = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.gratuitous_arp = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.incoming_forwarding = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.tos_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.tos = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.ttl = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.delayed_ack = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.tcp_nagle = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.tcp_wsf_state = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.tcp_wsf = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.tcp_timer_scale = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.tcp_timestamp = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.redirect = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.def_task_mgmt_timeout = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.header_digest = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.data_digest = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.immediate_data = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.initial_r2t = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.data_seq_inorder = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.data_pdu_inorder = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.erl = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.max_receive_data_len = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.first_burst_len = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.max_outstanding_r2t = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.max_burst_len = 0
Oct 30 14:05:50 user nova-compute[74319]: iface.chap_auth = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.bidi_chap = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.strict_login_compliance = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.discovery_auth = <empty>
Oct 30 14:05:50 user nova-compute[74319]: iface.discovery_logout = <empty>
Oct 30 14:05:50 user nova-compute[74319]: node.discovery_address = <empty>
Oct 30 14:05:50 user nova-compute[74319]: node.discovery_port = 0
Oct 30 14:05:50 user nova-compute[74319]: node.discovery_type = static
Oct 30 14:05:50 user nova-compute[74319]: node.session.initial_cmdsn = 0
Oct 30 14:05:50 user nova-compute[74319]: node.session.initial_login_retry_max = 8
Oct 30 14:05:50 user nova-compute[74319]: node.session.xmit_thread_priority = -20
Oct 30 14:05:50 user nova-compute[74319]: node.session.cmds_max = 128
Oct 30 14:05:50 user nova-compute[74319]: node.session.queue_depth = 32
Oct 30 14:05:50 user nova-compute[74319]: node.session.nr_sessions = 1
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.authmethod = CHAP
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.username = wrjeKdys
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.password = ***
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.username_in = <empty>
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.password_in = <empty>
Oct 30 14:05:50 user nova-compute[74319]: node.session.auth.chap_algs = MD5
Oct 30 14:05:50 user nova-compute[74319]: node.session.timeo.replacement_timeout = 120
Oct 30 14:05:50 user nova-compute[74319]: node.session.err_timeo.abort_timeout = 15
Oct 30 14:05:50 user nova-compute[74319]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 14:05:50 user nova-compute[74319]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 14:05:50 user nova-compute[74319]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.FastAbort = Yes
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.InitialR2T = No
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.ImmediateData = Yes
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.MaxConnections = 1
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 14:05:50 user nova-compute[74319]: node.session.iscsi.ERL = 0
Oct 30 14:05:50 user nova-compute[74319]: node.session.scan = manual
Oct 30 14:05:50 user nova-compute[74319]: node.session.reopen_max = 0
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].address = 172.16.0.220
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].port = 3260
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].startup = manual
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].tcp.window_size = 524288
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].tcp.type_of_service = 0
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].timeo.logout_timeout = 15
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].timeo.login_timeout = 15
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].timeo.auth_timeout = 45
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.DataDigest = None
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.IFMarker = No
Oct 30 14:05:50 user nova-compute[74319]: node.conn[0].iscsi.OFMarker = No
Oct 30 14:05:50 user nova-compute[74319]: # END RECORD
Oct 30 14:05:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-86eadb9d-c1c2-4a14-97e4-d9609b2964b0 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.571s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b018afb-34c0-4dd3-acc4-a9b3fde1249f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae089c-c30c-4f30-a189-1f9c51965545]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrjeKdys {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrjeKdys" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[163b8b9b-af3d-4a1f-b63a-a84d2ff4011a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrjeKdys'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8896558-7fc3-4f90-ab2e-7da95ec3c0fd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b2b4b-9998-40a1-bb3f-c53e83491923]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:05:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:05:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.163s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] HCTL ('34', '0', '0', 0) found on session 20 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8fbea3-cef2-4ef8-bcb8-66416ba9ba5d]: (4, ('0 0 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 20 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== connect_volume: return (189ms) {'type': 'block', 'scsi_wwn': '23731633031393366', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731633031393366', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] No waiting events found dispatching network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:50 user nova-compute[74319]: WARNING nova.compute.manager [req-40993cc8-e336-4c64-90c9-d5a9b9d53141 req-da35a612-94d8-4656-af4c-d17956c97d96 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received unexpected event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b for instance with vm_state building and task_state spawning.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1439463144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1439463144',id=20,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:04:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-jx544glu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:04:29Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=3fb6cc13-e069-46bc-9b0b-50fe57103fd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:c1:b4:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:c1:b4:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<3fb6cc13-e069-46bc-9b0b-50fe57103fd5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:05:50 user nova-compute[74319]:   <uuid>3fb6cc13-e069-46bc-9b0b-50fe57103fd5</uuid>
Oct 30 14:05:50 user nova-compute[74319]:   <name>instance-00000014</name>
Oct 30 14:05:50 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:05:50 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:05:50 user nova-compute[74319]:   <metadata>
Oct 30 14:05:50 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:05:50 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1439463144</nova:name>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:05:50</nova:creationTime>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:05:50 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:05:50 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:owner>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:05:50 user nova-compute[74319]:       </nova:owner>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:05:50 user nova-compute[74319]:       <nova:ports>
Oct 30 14:05:50 user nova-compute[74319]:         <nova:port uuid="b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9">
Oct 30 14:05:50 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:05:50 user nova-compute[74319]:         </nova:port>
Oct 30 14:05:50 user nova-compute[74319]:       </nova:ports>
Oct 30 14:05:50 user nova-compute[74319]:     </nova:instance>
Oct 30 14:05:50 user nova-compute[74319]:   </metadata>
Oct 30 14:05:50 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:05:50 user nova-compute[74319]:     <system>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="serial">3fb6cc13-e069-46bc-9b0b-50fe57103fd5</entry>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="uuid">3fb6cc13-e069-46bc-9b0b-50fe57103fd5</entry>
Oct 30 14:05:50 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:05:50 user nova-compute[74319]:     </system>
Oct 30 14:05:50 user nova-compute[74319]:   </sysinfo>
Oct 30 14:05:50 user nova-compute[74319]:   <os>
Oct 30 14:05:50 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:05:50 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:05:50 user nova-compute[74319]:   </os>
Oct 30 14:05:50 user nova-compute[74319]:   <features>
Oct 30 14:05:50 user nova-compute[74319]:     <acpi/>
Oct 30 14:05:50 user nova-compute[74319]:     <apic/>
Oct 30 14:05:50 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:05:50 user nova-compute[74319]:   </features>
Oct 30 14:05:50 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:05:50 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:05:50 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:05:50 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:05:50 user nova-compute[74319]:   </clock>
Oct 30 14:05:50 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:05:50 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:05:50 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:05:50 user nova-compute[74319]:   </cpu>
Oct 30 14:05:50 user nova-compute[74319]:   <devices>
Oct 30 14:05:50 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:05:50 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:05:50 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:05:50 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:05:50 user nova-compute[74319]:       <serial>4af4e65e-97af-4a89-b347-79e53e94f14f</serial>
Oct 30 14:05:50 user nova-compute[74319]:     </disk>
Oct 30 14:05:50 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:05:50 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:05:50 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue"/>
Oct 30 14:05:50 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:05:50 user nova-compute[74319]:       <boot order="1"/>
Oct 30 14:05:50 user nova-compute[74319]:     </disk>
Oct 30 14:05:50 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:05:50 user nova-compute[74319]:       <mac address="fa:16:3e:c1:b4:48"/>
Oct 30 14:05:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:50 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:05:50 user nova-compute[74319]:       <target dev="tapb6c1c1c5-d0"/>
Oct 30 14:05:50 user nova-compute[74319]:     </interface>
Oct 30 14:05:50 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:05:50 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/console.log" append="off"/>
Oct 30 14:05:50 user nova-compute[74319]:     </serial>
Oct 30 14:05:50 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:05:50 user nova-compute[74319]:     <video>
Oct 30 14:05:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:05:50 user nova-compute[74319]:     </video>
Oct 30 14:05:50 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:05:50 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:05:50 user nova-compute[74319]:     </rng>
Oct 30 14:05:50 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:05:50 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:05:50 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:05:50 user nova-compute[74319]:     </memballoon>
Oct 30 14:05:50 user nova-compute[74319]:   </devices>
Oct 30 14:05:50 user nova-compute[74319]: </domain>
Oct 30 14:05:50 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:05:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance destroyed successfully.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:c1:b4:48, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:05:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Instance spawned successfully.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:05:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance spawned successfully.
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:05:51 user nova-compute[74319]: INFO nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Took 9.06 seconds to spawn the instance on the hypervisor.
Oct 30 14:05:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:51 user nova-compute[74319]: INFO nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Took 8.27 seconds to spawn the instance on the hypervisor.
Oct 30 14:05:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:51 user nova-compute[74319]: INFO nova.compute.manager [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Took 10.21 seconds to build instance.
Oct 30 14:05:51 user nova-compute[74319]: INFO nova.compute.manager [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Took 9.24 seconds to build instance.
Oct 30 14:05:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-67d4f9ee-1094-4785-8e3c-8feaa7334d35 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.338s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3edb52c6-62c5-468e-802b-7f49f7569e73 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.432s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:53 user nova-compute[74319]: WARNING nova.compute.manager [req-25c504f9-64ba-45e9-b1ff-dfc689565dd1 req-51e12ed4-cfbb-494a-b034-b941e4eda5d5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state active and task_state rescuing.
Oct 30 14:05:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ae4b6563-caeb-49dd-8d3d-234099f25f7d tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:55 user nova-compute[74319]: WARNING nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state None.
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:55 user nova-compute[74319]: WARNING nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state None.
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:05:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:05:55 user nova-compute[74319]: WARNING nova.compute.manager [req-701a768e-487d-495a-8131-4185651307af req-4039b72a-a555-4aa8-ae63-89315ea02702 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state None.
Oct 30 14:06:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:06:04 user nova-compute[74319]: INFO nova.compute.claims [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Claim successful on node user
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:06:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:06:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.policy [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f860f101c5034c638821e668d33eeeff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee6fce9483d048b580da3d18df44316d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:06:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Creating image(s)
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "/opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "/opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.207s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Successfully created port: a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Cannot resize image /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Ensure instance console log exists: /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Successfully updated port: a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquired lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-changed-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Refreshing instance network info cache due to event network-changed-a38e6e53-8223-4e6d-b1e8-5fcdf9460891. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] Acquiring lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updating instance_info_cache with network_info: [{"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Releasing lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Instance network_info: |[{"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] Acquired lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.neutron [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Refreshing network info cache for port a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Start _get_guest_xml network_info=[{"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:06:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:06:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427461180',display_name='tempest-AttachVolumeNegativeTest-server-1427461180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427461180',id=26,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9w7a9GSc6Y4gyxaPEr0POl9Pp2lwBK44QLXRMUnu3PLwEWgk4f136/ACXw1LRXSek1yijkBEuewN0V/KcrsO815CC132TvU7Sy9V+//1tInBUieMZay/Oi8IFawayWQ==',key_name='tempest-keypair-108150786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40y3v1ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=f91ffe95-1dd6-40f9-b66c-e32c2741209b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'pci_devices' on Instance uuid f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:06:06 user nova-compute[74319]:   <uuid>f91ffe95-1dd6-40f9-b66c-e32c2741209b</uuid>
Oct 30 14:06:06 user nova-compute[74319]:   <name>instance-0000001a</name>
Oct 30 14:06:06 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:06:06 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:06:06 user nova-compute[74319]:   <metadata>
Oct 30 14:06:06 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:06:06 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1427461180</nova:name>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:06:06</nova:creationTime>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:06:06 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:06:06 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:owner>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:user uuid="f860f101c5034c638821e668d33eeeff">tempest-AttachVolumeNegativeTest-1763755820-project-member</nova:user>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:project uuid="ee6fce9483d048b580da3d18df44316d">tempest-AttachVolumeNegativeTest-1763755820</nova:project>
Oct 30 14:06:06 user nova-compute[74319]:       </nova:owner>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:06:06 user nova-compute[74319]:       <nova:ports>
Oct 30 14:06:06 user nova-compute[74319]:         <nova:port uuid="a38e6e53-8223-4e6d-b1e8-5fcdf9460891">
Oct 30 14:06:06 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:06:06 user nova-compute[74319]:         </nova:port>
Oct 30 14:06:06 user nova-compute[74319]:       </nova:ports>
Oct 30 14:06:06 user nova-compute[74319]:     </nova:instance>
Oct 30 14:06:06 user nova-compute[74319]:   </metadata>
Oct 30 14:06:06 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:06:06 user nova-compute[74319]:     <system>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="serial">f91ffe95-1dd6-40f9-b66c-e32c2741209b</entry>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="uuid">f91ffe95-1dd6-40f9-b66c-e32c2741209b</entry>
Oct 30 14:06:06 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:06:06 user nova-compute[74319]:     </system>
Oct 30 14:06:06 user nova-compute[74319]:   </sysinfo>
Oct 30 14:06:06 user nova-compute[74319]:   <os>
Oct 30 14:06:06 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:06:06 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:06:06 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:06:06 user nova-compute[74319]:   </os>
Oct 30 14:06:06 user nova-compute[74319]:   <features>
Oct 30 14:06:06 user nova-compute[74319]:     <acpi/>
Oct 30 14:06:06 user nova-compute[74319]:     <apic/>
Oct 30 14:06:06 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:06:06 user nova-compute[74319]:   </features>
Oct 30 14:06:06 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:06:06 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:06:06 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:06:06 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:06:06 user nova-compute[74319]:   </clock>
Oct 30 14:06:06 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:06:06 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:06:06 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:06:06 user nova-compute[74319]:   </cpu>
Oct 30 14:06:06 user nova-compute[74319]:   <devices>
Oct 30 14:06:06 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:06:06 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:06:06 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk"/>
Oct 30 14:06:06 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:06:06 user nova-compute[74319]:     </disk>
Oct 30 14:06:06 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:06:06 user nova-compute[74319]:       <mac address="fa:16:3e:88:8f:3c"/>
Oct 30 14:06:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:06:06 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:06:06 user nova-compute[74319]:       <target dev="tapa38e6e53-82"/>
Oct 30 14:06:06 user nova-compute[74319]:     </interface>
Oct 30 14:06:06 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:06:06 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/console.log" append="off"/>
Oct 30 14:06:06 user nova-compute[74319]:     </serial>
Oct 30 14:06:06 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:06:06 user nova-compute[74319]:     <video>
Oct 30 14:06:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:06:06 user nova-compute[74319]:     </video>
Oct 30 14:06:06 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:06:06 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:06:06 user nova-compute[74319]:     </rng>
Oct 30 14:06:06 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:06:06 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:06:06 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:06:06 user nova-compute[74319]:     </memballoon>
Oct 30 14:06:06 user nova-compute[74319]:   </devices>
Oct 30 14:06:06 user nova-compute[74319]: </domain>
Oct 30 14:06:06 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427461180',display_name='tempest-AttachVolumeNegativeTest-server-1427461180',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427461180',id=26,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9w7a9GSc6Y4gyxaPEr0POl9Pp2lwBK44QLXRMUnu3PLwEWgk4f136/ACXw1LRXSek1yijkBEuewN0V/KcrsO815CC132TvU7Sy9V+//1tInBUieMZay/Oi8IFawayWQ==',key_name='tempest-keypair-108150786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40y3v1ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:06:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=f91ffe95-1dd6-40f9-b66c-e32c2741209b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG os_vif [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd12c621a-21a8-5d99-bc59-9f35449c2dd7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa38e6e53-82, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa38e6e53-82, col_values=(('qos', UUID('11500796-e145-4e5b-a146-4e2e2d753c15')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa38e6e53-82, col_values=(('external_ids', {'iface-id': 'a38e6e53-8223-4e6d-b1e8-5fcdf9460891', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:8f:3c', 'vm-uuid': 'f91ffe95-1dd6-40f9-b66c-e32c2741209b'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:06 user nova-compute[74319]: INFO os_vif [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82')
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:06:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:88:8f:3c, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:06:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updated VIF entry in instance network info cache for port a38e6e53-8223-4e6d-b1e8-5fcdf9460891. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:06:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updating instance_info_cache with network_info: [{"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:06:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67b8477b-ca1a-4574-bab6-7d5a34f06a0f req-79766f80-a2bf-469c-8082-cac6a77c41dd service nova] Releasing lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] No waiting events found dispatching network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:08 user nova-compute[74319]: WARNING nova.compute.manager [req-ac56108e-68dd-4dd7-94ae-aa94dedbf98a req-6b031b15-5349-41a4-9a8d-4c61aa54f42d service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received unexpected event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 for instance with vm_state building and task_state spawning.
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-changed-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Refreshing instance network info cache due to event network-changed-2511e72f-9d7c-488f-9430-a33f351f40bb. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] Acquiring lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] Acquired lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Refreshing network info cache for port 2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updated VIF entry in instance network info cache for port 2511e72f-9d7c-488f-9430-a33f351f40bb. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating instance_info_cache with network_info: [{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:06:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3ee951ee-be0c-4cd9-8bc5-63e41d83c1c1 req-8eb53713-2109-4d61-b3dc-b21d8b4d48a1 service nova] Releasing lock "refresh_cache-e386fa6a-5c77-4482-9bd7-4d3ef21cf802" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'flavor' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:09 user nova-compute[74319]: INFO nova.compute.manager [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attaching volume 894bfe12-6152-4aa4-995a-760457cbd9e0 to /dev/vdb
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.utils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae5fef-57e0-4d82-b07e-dc4c775539d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88966037-4aa6-416a-aad0-d186a61863fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6ebd05-c8e5-48d6-a163-4f983ba12da4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a3199e-6766-4bd3-b7e3-b81923f9c5f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:06:09 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:06:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac96b3d3-cba5-49ac-b484-3b8618ec789b]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG os_brick.utils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:09 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating existing volume attachment record: 1b206146-6495-4858-811c-c2b6c86ef175 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] No waiting events found dispatching network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:10 user nova-compute[74319]: WARNING nova.compute.manager [req-7da0332c-b032-43ca-a65c-d5d2747c8790 req-15d05d85-96b1-4240-a132-ca428e6aebc6 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received unexpected event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 for instance with vm_state building and task_state spawning.
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:06:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Instance spawned successfully.
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:10 user nova-compute[74319]: INFO nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 30 14:06:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:06:10 user nova-compute[74319]: INFO nova.compute.manager [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Took 6.80 seconds to build instance.
Oct 30 14:06:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7afb575d-638e-454c-8d77-2060f910af52 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.933s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:25 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:28 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:28 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:28 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[323d8783-c12d-4223-a246-4741d3af26ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:06:28 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f2f15-02ed-4b0d-8440-a90417a6b4f5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0] added
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f392c4d-8cbf-4aeb-881e-2a47e2f2de90]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[461a8c7e-6621-45d8-85a1-d1ce244d6ba3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvuRTexf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvuRTexf" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec78d31-fd8d-49a4-aac6-d8f8b37a6fb5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvuRTexf'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fcea05-4b23-4c76-980a-df2e69a8fd1a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb422a16-e6a4-4440-8c68-eabc1bdff817]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f6504-3ff7-4ecd-8d7d-ce75b3eebabb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]
Oct 30 14:06:29 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6cf088-73ad-4559-83a5-b952c356641a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8cc169-3aeb-4edc-9d99-f68cb50d9bef]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:29 user nova-compute[74319]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:29 user nova-compute[74319]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b009b57-c587-4e38-8239-331f0c414557]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:06:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.247196197509766GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23737323232653739', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737323232653739', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'flavor' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:06:30 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:06:30 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:06:30 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:06:30 user nova-compute[74319]:   <serial>894bfe12-6152-4aa4-995a-760457cbd9e0</serial>
Oct 30 14:06:30 user nova-compute[74319]: </disk>
Oct 30 14:06:30 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 12d30eed-d927-4fc9-bf54-fe9fb986b140 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f91ffe95-1dd6-40f9-b66c-e32c2741209b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:d2:49:67, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:06:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c00ec4c-c1d8-4a7b-a670-037b4d6ec4e6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.430s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:32 user nova-compute[74319]: INFO nova.compute.manager [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Rebuilding instance
Oct 30 14:06:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:06:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:06:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:33 user nova-compute[74319]: WARNING nova.compute.manager [req-74986b7b-3ac4-4f92-9a59-acced3e0c012 req-4151e987-8f1b-4827-ab35-a53f6bc4f1ee service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuilding.
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updating instance_info_cache with network_info: [{"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance destroyed successfully.
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: INFO nova.compute.manager [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Detaching volume 894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:06:33 user nova-compute[74319]: INFO nova.virt.block_device [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attempting to driver detach volume 894bfe12-6152-4aa4-995a-760457cbd9e0 from mountpoint /dev/vdb
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Attempting to detach device vdb from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:06:33 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:06:33 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:06:33 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:06:33 user nova-compute[74319]:   <serial>894bfe12-6152-4aa4-995a-760457cbd9e0</serial>
Oct 30 14:06:33 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:06:33 user nova-compute[74319]: </disk>
Oct 30 14:06:33 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully detached device vdb from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the persistent domain config.
Oct 30 14:06:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:33 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c83bbc-afdc-45be-a6a8-5816fcaf8052]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:06:33 user nova-compute[74319]: No targets found.
Oct 30 14:06:33 user nova-compute[74319]: iSNS:
Oct 30 14:06:33 user nova-compute[74319]: No targets found.
Oct 30 14:06:33 user nova-compute[74319]: STATIC:
Oct 30 14:06:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:06:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:06:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:06:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:06:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:06:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:06:33 user nova-compute[74319]: FIRMWARE:
Oct 30 14:06:33 user nova-compute[74319]: No targets found.
Oct 30 14:06:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:06:33 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:06:33 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f9acd-8a43-42d5-8edd-e95e3111ddba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e2bbaf-5df7-4358-bda2-9998bb685f87]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:33 user nova-compute[74319]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:33 user nova-compute[74319]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a0138670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[080f5ad4-8887-4ec7-bc0d-1b981460a53b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bfbad9-9784-429e-baf4-59042f623bac]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c3304d-a34e-4888-9ecc-5593de8bc447]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:06:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47a9afc-39c9-4e08-ad6d-04d06a50e829]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6902ace8-878a-4d06-9207-31603b951cd4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc0cc36-9d4a-48e8-94c2-2c9b58906bdc]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]
Oct 30 14:06:34 user nova-compute[74319]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.
Oct 30 14:06:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b992a4-41c0-4ac5-b933-9301392a07fb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== disconnect_volume: return (297ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:06:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance destroyed successfully.
Oct 30 14:06:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-ServerActionsTestOtherA-server-122720079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:06:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG os_vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2511e72f-9d, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6cfc509-2663-463b-b563-eff867880e28) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:34 user nova-compute[74319]: INFO os_vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d')
Oct 30 14:06:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef3f05-0a9f-48db-a6b3-89bf376dd8e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:06:35 user nova-compute[74319]: No targets found.
Oct 30 14:06:35 user nova-compute[74319]: iSNS:
Oct 30 14:06:35 user nova-compute[74319]: No targets found.
Oct 30 14:06:35 user nova-compute[74319]: STATIC:
Oct 30 14:06:35 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:06:35 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:06:35 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:06:35 user nova-compute[74319]: FIRMWARE:
Oct 30 14:06:35 user nova-compute[74319]: No targets found.
Oct 30 14:06:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:06:35 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:06:35 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2db1b-8701-4f0f-bd2f-361e53b1ef2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed17e6-cde4-4269-9095-f95acaf38c74]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99837d870>, {}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Disconnecting from: [] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== disconnect_volume: return (61ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:06:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Deleting instance files /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802_del
Oct 30 14:06:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Deletion of /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802_del complete
Oct 30 14:06:35 user nova-compute[74319]: INFO nova.virt.block_device [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Booting with volume 894bfe12-6152-4aa4-995a-760457cbd9e0 at /dev/vdb
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING nova.compute.manager [req-ff915a4f-9464-4c47-901d-3c7ff9528d30 req-c82f6b83-39d7-405c-a3eb-d09eaeccd046 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_block_device_mapping.
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.utils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64b9100-476f-43db-bc4b-fd3ebc6230a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9138ab2d-a44d-48e0-bae7-7a3bccbb3322]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f042a-6165-46cd-8c8a-7c4ff5d1d428]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[32225576-e260-4a11-8883-d997d7b494dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:06:35 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:06:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bf9b65-cb8f-4642-a917-1299cb179f25]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG os_brick.utils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:35 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating existing volume attachment record: 44288a9d-e319-4e81-9a71-6febe9f692a1 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:06:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:06:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Creating image(s)
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk 1073741824" returned: 0 in 0.046s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Cannot resize image /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Ensure instance console log exists: /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start _get_guest_xml network_info=[{"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '44288a9d-e319-4e81-9a71-6febe9f692a1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e386fa6a-5c77-4482-9bd7-4d3ef21cf802', 'attached_at': '', 'detached_at': '', 'volume_id': '894bfe12-6152-4aa4-995a-760457cbd9e0', 'serial': '894bfe12-6152-4aa4-995a-760457cbd9e0'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:06:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 14:06:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'vcpu_model' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:06:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:06:54 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e4765c-08f8-4144-961d-3fe8f3c14f9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:06:54 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf48ef0-db4f-4acd-9b4b-62857eb7b1d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0] added
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8530d6-35a1-4b15-8c43-1405cdda0f08]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fede19b-29df-4d63-aa12-a72d482d2f07]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvuRTexf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gvuRTexf" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3fc9b-798f-453b-9c70-6ccf20b4ea7d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gvuRTexf'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2860dfbf-660d-4d99-a82f-c69a38576fca]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed4c570-87fd-4a49-9ee3-026a96f92138]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc83e9-73a7-40bf-8492-0095781c0279]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]
Oct 30 14:06:54 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f6e67-1742-4065-b3fc-61d7f86f850c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[220174e4-a4c3-42c2-a83d-b06b757181bf]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:54 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:06:54 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:06:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b0622-93d2-4966-ba08-2f2fa81962ba]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:06:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23737323232653739', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737323232653739', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-ServerActionsTestOtherA-server-122720079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:06:55 user nova-compute[74319]:   <uuid>e386fa6a-5c77-4482-9bd7-4d3ef21cf802</uuid>
Oct 30 14:06:55 user nova-compute[74319]:   <name>instance-00000015</name>
Oct 30 14:06:55 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:06:55 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:06:55 user nova-compute[74319]:   <metadata>
Oct 30 14:06:55 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:06:55 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:name>tempest-ServerActionsTestOtherA-server-122720079</nova:name>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:06:54</nova:creationTime>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:06:55 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:06:55 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:owner>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:user uuid="d03a462b75b14b4fb30f66a3b0e051d4">tempest-ServerActionsTestOtherA-768990641-project-member</nova:user>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:project uuid="0ae8f2e2f199408596776c53c41a7986">tempest-ServerActionsTestOtherA-768990641</nova:project>
Oct 30 14:06:55 user nova-compute[74319]:       </nova:owner>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:06:55 user nova-compute[74319]:       <nova:ports>
Oct 30 14:06:55 user nova-compute[74319]:         <nova:port uuid="2511e72f-9d7c-488f-9430-a33f351f40bb">
Oct 30 14:06:55 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:06:55 user nova-compute[74319]:         </nova:port>
Oct 30 14:06:55 user nova-compute[74319]:       </nova:ports>
Oct 30 14:06:55 user nova-compute[74319]:     </nova:instance>
Oct 30 14:06:55 user nova-compute[74319]:   </metadata>
Oct 30 14:06:55 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:06:55 user nova-compute[74319]:     <system>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="serial">e386fa6a-5c77-4482-9bd7-4d3ef21cf802</entry>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="uuid">e386fa6a-5c77-4482-9bd7-4d3ef21cf802</entry>
Oct 30 14:06:55 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:06:55 user nova-compute[74319]:     </system>
Oct 30 14:06:55 user nova-compute[74319]:   </sysinfo>
Oct 30 14:06:55 user nova-compute[74319]:   <os>
Oct 30 14:06:55 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:06:55 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:06:55 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:06:55 user nova-compute[74319]:   </os>
Oct 30 14:06:55 user nova-compute[74319]:   <features>
Oct 30 14:06:55 user nova-compute[74319]:     <acpi/>
Oct 30 14:06:55 user nova-compute[74319]:     <apic/>
Oct 30 14:06:55 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:06:55 user nova-compute[74319]:   </features>
Oct 30 14:06:55 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:06:55 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:06:55 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:06:55 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:06:55 user nova-compute[74319]:   </clock>
Oct 30 14:06:55 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:06:55 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:06:55 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:06:55 user nova-compute[74319]:   </cpu>
Oct 30 14:06:55 user nova-compute[74319]:   <devices>
Oct 30 14:06:55 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:06:55 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:06:55 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk"/>
Oct 30 14:06:55 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:06:55 user nova-compute[74319]:     </disk>
Oct 30 14:06:55 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:06:55 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:06:55 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:06:55 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:06:55 user nova-compute[74319]:       <serial>894bfe12-6152-4aa4-995a-760457cbd9e0</serial>
Oct 30 14:06:55 user nova-compute[74319]:     </disk>
Oct 30 14:06:55 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:06:55 user nova-compute[74319]:       <mac address="fa:16:3e:d2:49:67"/>
Oct 30 14:06:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:06:55 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:06:55 user nova-compute[74319]:       <target dev="tap2511e72f-9d"/>
Oct 30 14:06:55 user nova-compute[74319]:     </interface>
Oct 30 14:06:55 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:06:55 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/console.log" append="off"/>
Oct 30 14:06:55 user nova-compute[74319]:     </serial>
Oct 30 14:06:55 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:06:55 user nova-compute[74319]:     <video>
Oct 30 14:06:55 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:06:55 user nova-compute[74319]:     </video>
Oct 30 14:06:55 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:06:55 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:06:55 user nova-compute[74319]:     </rng>
Oct 30 14:06:55 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:06:55 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:06:55 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:06:55 user nova-compute[74319]:     </memballoon>
Oct 30 14:06:55 user nova-compute[74319]:   </devices>
Oct 30 14:06:55 user nova-compute[74319]: </domain>
Oct 30 14:06:55 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-ServerActionsTestOtherA-server-122720079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:06:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG os_vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e47a755-d664-524e-bfd5-0a06e180c37d', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2511e72f-9d, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2511e72f-9d, col_values=(('qos', UUID('eee21b98-b4ba-4aa8-b133-b3a9503f19a4')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2511e72f-9d, col_values=(('external_ids', {'iface-id': '2511e72f-9d7c-488f-9430-a33f351f40bb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:49:67', 'vm-uuid': 'e386fa6a-5c77-4482-9bd7-4d3ef21cf802'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:06:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:55 user nova-compute[74319]: INFO os_vif [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d')
Oct 30 14:06:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:06:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:06:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:d2:49:67, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:57 user nova-compute[74319]: WARNING nova.compute.manager [req-7f986578-27e7-4556-96d1-bc4ce080116d req-e646241c-4ff0-4fad-8598-ea4275a7065c service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_spawning.
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:06:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance spawned successfully.
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:06:59 user nova-compute[74319]: WARNING nova.compute.manager [req-0d1f3565-dd4c-494a-ab3c-4586a7e4fb53 req-7f3601df-8d7b-4194-8bb6-72c698e1c6c1 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state rebuild_spawning.
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74319) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Oct 30 14:06:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-62c4a64f-a074-4ad3-8bd4-f9a95b03d810 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:02 user nova-compute[74319]: INFO nova.compute.manager [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Terminating instance
Oct 30 14:07:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-unplugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] No waiting events found dispatching network-vif-unplugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-22f6ec26-9b6d-479a-940d-135cd47290cb req-e62b7d6b-c991-411f-8fd9-7505eb5286ec service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-unplugged-5c68026a-5c79-432d-8702-0db2f8f5d369 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:07:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Instance destroyed successfully.
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lazy-loading 'resources' on Instance uuid 12d30eed-d927-4fc9-bf54-fe9fb986b140 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-2121408991',display_name='tempest-VolumesNegativeTest-instance-2121408991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-2121408991',id=22,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0d8eae6f9ab46278bc61a8aa3a1ce83',ramdisk_id='',reservation_id='r-12w55mqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1849580014',owner_user_name='tempest-VolumesNegativeTest-1849580014-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:05:19Z,user_data=None,user_id='03249afd9f4c4505b53fd6df9b16653d',uuid=12d30eed-d927-4fc9-bf54-fe9fb986b140,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converting VIF {"id": "5c68026a-5c79-432d-8702-0db2f8f5d369", "address": "fa:16:3e:0a:86:39", "network": {"id": "be9c0f34-8dff-4dea-8428-2eba90b23fc4", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.50", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "bf96c3970cd743f4bce9faa2e5a4de19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c68026a-5c", "ovs_interfaceid": "5c68026a-5c79-432d-8702-0db2f8f5d369", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG os_vif [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c68026a-5c, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f432ad69-d511-487d-a364-79cab0a30bc9) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:03 user nova-compute[74319]: INFO os_vif [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:86:39,bridge_name='br-int',has_traffic_filtering=True,id=5c68026a-5c79-432d-8702-0db2f8f5d369,network=Network(be9c0f34-8dff-4dea-8428-2eba90b23fc4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c68026a-5c')
Oct 30 14:07:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Deleting instance files /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140_del
Oct 30 14:07:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Deletion of /opt/stack/data/nova/instances/12d30eed-d927-4fc9-bf54-fe9fb986b140_del complete
Oct 30 14:07:03 user nova-compute[74319]: INFO nova.compute.manager [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 30 14:07:03 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:03 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Took 0.39 seconds to deallocate network for instance.
Oct 30 14:07:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:04 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Deleted allocations for instance 12d30eed-d927-4fc9-bf54-fe9fb986b140
Oct 30 14:07:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b2ec86c7-9a75-4318-b339-b0b3676c32fe tempest-VolumesNegativeTest-1849580014 tempest-VolumesNegativeTest-1849580014-project-member] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.645s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] Acquiring lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] Lock "12d30eed-d927-4fc9-bf54-fe9fb986b140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] No waiting events found dispatching network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:04 user nova-compute[74319]: WARNING nova.compute.manager [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received unexpected event network-vif-plugged-5c68026a-5c79-432d-8702-0db2f8f5d369 for instance with vm_state deleted and task_state None.
Oct 30 14:07:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-a655617f-efaa-4669-a809-a036352f51ea req-709bd269-65a9-4c1a-aba2-94f62d4f865b service nova] [instance: 12d30eed-d927-4fc9-bf54-fe9fb986b140] Received event network-vif-deleted-5c68026a-5c79-432d-8702-0db2f8f5d369 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:07:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:22 user nova-compute[74319]: INFO nova.compute.manager [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Unshelving
Oct 30 14:07:22 user nova-compute[74319]: INFO nova.virt.block_device [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Booting with volume 7a9403c4-fe98-45dd-b6b2-034cca44423d at /dev/vdc
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.utils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e0d6d2-2b85-448d-bcc4-e77467a1fe91]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb18cae2-1b08-4d7e-b766-2e6f81181f99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29e043b-6992-4ec1-8b67-900c31ad4a5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdcbff6-a8d6-432b-81c0-5b22b1426579]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:22 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:07:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c53bbc-de58-4477-ac1c-931bf370ad17]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG os_brick.utils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:22 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating existing volume attachment record: ff86b3bc-2986-42cb-a3a7-b566a95143d1 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:07:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:25 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:29 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:07:29 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7604MB free_disk=25.271072387695312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f91ffe95-1dd6-40f9-b66c-e32c2741209b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:07:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.521s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-changed-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Refreshing instance network info cache due to event network-changed-da3bbafe-404d-4006-9170-5b0f56485e8b. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] Acquiring lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] Acquired lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Refreshing network info cache for port da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing instance network info cache due to event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updated VIF entry in instance network info cache for port da3bbafe-404d-4006-9170-5b0f56485e8b. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating instance_info_cache with network_info: [{"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b8263ebc-7834-4277-88f6-ec14dcb3e651 req-ba39b90a-cb91-455d-8e86-f8ff73412222 service nova] Releasing lock "refresh_cache-8c7acd12-fe23-479d-9ef2-5f4341b13267" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updated VIF entry in instance network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12e56877-ffcb-4938-a1dd-8f604378e26d req-39629a5b-c9e2-4355-833c-67d55cc1b300 service nova] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:31 user nova-compute[74319]: INFO nova.compute.manager [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attaching volume 2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea to /dev/vdb
Oct 30 14:07:31 user nova-compute[74319]: DEBUG os_brick.utils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e9fe5b-6539-4876-a209-8f82e2e07511]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1daeae69-08e5-46d3-b99a-7f1478c88a26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a40bee-5822-42b6-a1b7-df80a6702444]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[86af872a-addb-483b-a030-25e77ca0f238]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:32 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453ae00-6ff2-42f4-a686-874aae09a034]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG os_brick.utils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating existing volume attachment record: 98e57242-f5df-4730-b621-728566036c3c {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:07:32 user nova-compute[74319]: INFO nova.compute.manager [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] instance snapshotting
Oct 30 14:07:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Beginning live snapshot process
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-changed-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Refreshing instance network info cache due to event network-changed-c83bbef5-d67d-4021-8153-e35b9019544e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Refreshing network info cache for port c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f.delta 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f.delta 1073741824" returned: 0 in 0.066s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updated VIF entry in instance network info cache for port c83bbef5-d67d-4021-8153-e35b9019544e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e54b0c2-0bc3-4a33-8b28-09d70d6ceac3 req-e6b7f75d-c732-41c0-8098-440828280fec service nova] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:07:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 14:07:34 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:07:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f.delta /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f.delta /opt/stack/data/nova/instances/snapshots/tmpvwsqapdk/cd10b4668e154ff9beb2b4d45482eb1f" returned: 0 in 0.474s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Snapshot extracted, beginning image upload
Oct 30 14:07:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:07:37 user nova-compute[74319]: INFO nova.compute.manager [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Unrescuing
Oct 30 14:07:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:07:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:37 user nova-compute[74319]: DEBUG nova.objects.instance [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'flavor' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Snapshot image upload complete
Oct 30 14:07:38 user nova-compute[74319]: INFO nova.compute.manager [None req-6a4802d8-7500-4554-9415-9a778ca42421 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Took 5.82 seconds to snapshot the instance on the hypervisor.
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:38 user nova-compute[74319]: WARNING nova.compute.manager [req-88a7f5f8-0995-40d5-a7b6-e916f5766775 req-7eed2099-808f-4806-9634-2c545870579f service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:38 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance destroyed successfully.
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:39 user nova-compute[74319]: INFO nova.compute.manager [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Attaching volume 8e43d91d-336f-4c3b-8572-51860e6b6265 to /dev/vdb
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.utils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc3504-46dd-47c8-aaed-8a359ab975eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de900bfe-cd7c-4d88-925f-d3b54614241e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80187e9-77e3-480b-bcb2-d7669eaab909]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bd1f88-6983-4d38-8601-9c8b668c53e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:39 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:07:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf64ba08-ef75-4072-90e8-ef43b87409f1]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG os_brick.utils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:39 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating existing volume attachment record: 80f677b6-7632-40e0-8db1-ac9fc88f95ad {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:40 user nova-compute[74319]: WARNING nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:07:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:40 user nova-compute[74319]: WARNING nova.compute.manager [req-65f1542b-37b9-4daf-b3eb-9e14c1888eac req-c084c4ea-09a6-4e2a-abe3-c6330c370c19 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:07:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-16299f28-ca91-4010-9bc6-68c6512e7d90 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:07:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:42 user nova-compute[74319]: WARNING nova.compute.manager [req-fc8c7dd4-365f-4b71-8404-e285e447ee41 req-92dddd88-6cbf-4737-b3f4-e75af8ec9873 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:07:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_requests' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'numa_topology' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:07:43 user nova-compute[74319]: INFO nova.compute.claims [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Claim successful on node user
Oct 30 14:07:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:07:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:43 user nova-compute[74319]: INFO nova.network.neutron [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating port d4d45c22-1233-41d7-835a-23ff10d39344 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing instance network info cache due to event network-changed-d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] Acquiring lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:07:44 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Creating image(s)
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] Acquired lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Refreshing network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG nova.objects.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<00bf4369-a4dd-463a-ac55-12625d0a81a2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.part --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG nova.virt.images [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.part /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updated VIF entry in instance network info cache for port d4d45c22-1233-41d7-835a-23ff10d39344. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG nova.network.neutron [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8d87e01e-63a6-47af-8d21-de4c008af787 req-9821deba-b2c2-4015-b414-9ec086aa834d service nova] Releasing lock "refresh_cache-00bf4369-a4dd-463a-ac55-12625d0a81a2" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.part /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.converted" returned: 0 in 0.894s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.235s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json" returned: 0 in 0.230s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7,backing_fmt=raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7,backing_fmt=raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk 1073741824" returned: 0 in 0.060s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "1eb6427a3936402162f5a9ab82c5849e261bdbc7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'migration_context' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG nova.objects.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<00bf4369-a4dd-463a-ac55-12625d0a81a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:07:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Rebasing disk image.
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d -F raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d -F raw /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk" returned: 0 in 2.893s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Ensure instance console log exists: /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start _get_guest_xml network_info=[{"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='ac711f34d7ca2ce9682ab99f905f4ce2',container_format='bare',created_at=2023-10-30T14:05:30Z,direct_url=<?>,disk_format='qcow2',id=fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2051727474-shelved',owner='e173b99e7da54c6688ccc9969dbaa7f4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:05:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': 'ff86b3bc-2986-42cb-a3a7-b566a95143d1', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFvpWoOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '00bf4369-a4dd-463a-ac55-12625d0a81a2', 'attached_at': '', 'detached_at': '', 'volume_id': '7a9403c4-fe98-45dd-b6b2-034cca44423d', 'serial': '7a9403c4-fe98-45dd-b6b2-034cca44423d'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:07:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:07:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ac711f34d7ca2ce9682ab99f905f4ce2',container_format='bare',created_at=2023-10-30T14:05:30Z,direct_url=<?>,disk_format='qcow2',id=fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-2051727474-shelved',owner='e173b99e7da54c6688ccc9969dbaa7f4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:05:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<00bf4369-a4dd-463a-ac55-12625d0a81a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFvpWoOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:07:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:07:50 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260" returned: 21 in 0.037s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[542c005f-781a-40ed-9757-3835376d7229]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:07:50 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1830e20-18f6-4480-908e-548ae2c588f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d] added
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1ede19-6217-43f1-9ea3-2a714ab000b4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbcd3c-8dc0-4ecb-a8f0-fbd5c800c72f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFvpWoOC {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HFvpWoOC" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bc3436-e1af-4f2e-a0a6-e5a6f8163425]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HFvpWoOC'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cf4e19-d8a4-43ee-985c-ea97bd3e9c67]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc502f-24c4-4ab3-ab76-877b7bf99a8e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[76935cc7-39ed-4cfb-a38b-a992d2877632]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260]
Oct 30 14:07:50 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260] successful.
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[97787627-bc77-4200-950a-d3724c59583a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf2e1a4-fab1-40e4-874c-27eccb6e4e84]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:50 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c53bd61-2885-46f1-ac00-60c02d1ddab2]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFvpWoOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23662376639316364', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662376639316364', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1275219634',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:05:34.390011',shelved_host='user',shelved_image_id='fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_devices' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:51 user nova-compute[74319]: DEBUG nova.objects.base [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<00bf4369-a4dd-463a-ac55-12625d0a81a2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:07:52 user nova-compute[74319]:   <uuid>00bf4369-a4dd-463a-ac55-12625d0a81a2</uuid>
Oct 30 14:07:52 user nova-compute[74319]:   <name>instance-00000013</name>
Oct 30 14:07:52 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:07:52 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:07:52 user nova-compute[74319]:   <metadata>
Oct 30 14:07:52 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:07:52 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-2051727474</nova:name>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:07:50</nova:creationTime>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:07:52 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:07:52 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:owner>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:user uuid="72f5d276e62a472b92e46d28aa5a5286">tempest-AttachVolumeShelveTestJSON-282209841-project-member</nova:user>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:project uuid="e173b99e7da54c6688ccc9969dbaa7f4">tempest-AttachVolumeShelveTestJSON-282209841</nova:project>
Oct 30 14:07:52 user nova-compute[74319]:       </nova:owner>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:root type="image" uuid="fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7"/>
Oct 30 14:07:52 user nova-compute[74319]:       <nova:ports>
Oct 30 14:07:52 user nova-compute[74319]:         <nova:port uuid="d4d45c22-1233-41d7-835a-23ff10d39344">
Oct 30 14:07:52 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:07:52 user nova-compute[74319]:         </nova:port>
Oct 30 14:07:52 user nova-compute[74319]:       </nova:ports>
Oct 30 14:07:52 user nova-compute[74319]:     </nova:instance>
Oct 30 14:07:52 user nova-compute[74319]:   </metadata>
Oct 30 14:07:52 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:07:52 user nova-compute[74319]:     <system>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="serial">00bf4369-a4dd-463a-ac55-12625d0a81a2</entry>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="uuid">00bf4369-a4dd-463a-ac55-12625d0a81a2</entry>
Oct 30 14:07:52 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:07:52 user nova-compute[74319]:     </system>
Oct 30 14:07:52 user nova-compute[74319]:   </sysinfo>
Oct 30 14:07:52 user nova-compute[74319]:   <os>
Oct 30 14:07:52 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:07:52 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:07:52 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:07:52 user nova-compute[74319]:   </os>
Oct 30 14:07:52 user nova-compute[74319]:   <features>
Oct 30 14:07:52 user nova-compute[74319]:     <acpi/>
Oct 30 14:07:52 user nova-compute[74319]:     <apic/>
Oct 30 14:07:52 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:07:52 user nova-compute[74319]:   </features>
Oct 30 14:07:52 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:07:52 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:07:52 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:07:52 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:07:52 user nova-compute[74319]:   </clock>
Oct 30 14:07:52 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:07:52 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:07:52 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:07:52 user nova-compute[74319]:   </cpu>
Oct 30 14:07:52 user nova-compute[74319]:   <devices>
Oct 30 14:07:52 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:07:52 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:07:52 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk"/>
Oct 30 14:07:52 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:07:52 user nova-compute[74319]:     </disk>
Oct 30 14:07:52 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:07:52 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:07:52 user nova-compute[74319]:       <source dev="/dev/sdd"/>
Oct 30 14:07:52 user nova-compute[74319]:       <target dev="vdc" bus="virtio"/>
Oct 30 14:07:52 user nova-compute[74319]:       <serial>7a9403c4-fe98-45dd-b6b2-034cca44423d</serial>
Oct 30 14:07:52 user nova-compute[74319]:     </disk>
Oct 30 14:07:52 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:07:52 user nova-compute[74319]:       <mac address="fa:16:3e:39:2f:66"/>
Oct 30 14:07:52 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:07:52 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:07:52 user nova-compute[74319]:       <target dev="tapd4d45c22-12"/>
Oct 30 14:07:52 user nova-compute[74319]:     </interface>
Oct 30 14:07:52 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:07:52 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/console.log" append="off"/>
Oct 30 14:07:52 user nova-compute[74319]:     </serial>
Oct 30 14:07:52 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:07:52 user nova-compute[74319]:     <video>
Oct 30 14:07:52 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:07:52 user nova-compute[74319]:     </video>
Oct 30 14:07:52 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:07:52 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:07:52 user nova-compute[74319]:     </rng>
Oct 30 14:07:52 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:07:52 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:07:52 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:07:52 user nova-compute[74319]:     </memballoon>
Oct 30 14:07:52 user nova-compute[74319]:   </devices>
Oct 30 14:07:52 user nova-compute[74319]: </domain>
Oct 30 14:07:52 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1275219634',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:05:34.390011',shelved_host='user',shelved_image_id='fa9c812d-1b1b-48fa-a6c0-1451cba5fbc7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:07:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_vif [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61fda8ad-d4d5-5ffd-87be-0074f9ff2d1c', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4d45c22-12, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4d45c22-12, col_values=(('qos', UUID('af91e5dc-95f2-4282-b405-f5d3ac2629de')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4d45c22-12, col_values=(('external_ids', {'iface-id': 'd4d45c22-1233-41d7-835a-23ff10d39344', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:2f:66', 'vm-uuid': '00bf4369-a4dd-463a-ac55-12625d0a81a2'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:52 user nova-compute[74319]: INFO os_vif [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12')
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No VIF found with MAC fa:16:3e:39:2f:66, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbRloThH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:52 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:07:52 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:07:52 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ccc4b05-6f30-4a4d-9e24-c8bd6cdf8fec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:07:52 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30203d1f-81e5-49ad-aabc-ea21adac7840]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea] added
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[099e4cbc-3e1a-4b96-a588-d19232c48b81]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[33700f33-8e36-4b2a-9cc1-1d2fd141cc55]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbRloThH {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vbRloThH" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14036e5-01ec-4b93-af74-cb1dc43a9058]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vbRloThH'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[161b16eb-f2fa-4798-b5b5-f162a16f58e0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e3507b-c209-4526-bd4a-b4108183f0ce]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f58b7-d454-4df2-94c8-0a5ccfd8eaef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260]
Oct 30 14:07:52 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260] successful.
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd99898-c8c7-4c8a-bc2f-b58d39c26852]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88549d64-1e63-4bf5-aa1a-9791cc7a5097]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:07:52 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:07:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2d1863-9ba8-41b6-995c-2e5a3b655909]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:07:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbRloThH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23836323233373135', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836323233373135', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:07:53 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:07:53 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:07:53 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:07:53 user nova-compute[74319]:   <serial>2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea</serial>
Oct 30 14:07:53 user nova-compute[74319]: </disk>
Oct 30 14:07:53 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:53 user nova-compute[74319]: WARNING nova.compute.manager [req-5aba82d1-bf9b-4bfb-8894-ec5f545b8003 req-63a65a62-6c6d-41ff-ac9b-5446d7546f2c service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:07:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:07:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:07:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No VIF found with MAC fa:16:3e:5a:45:a6, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:07:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fef37183-f907-4e0b-936a-dc89a60253f7 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.853s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-changed-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Refreshing instance network info cache due to event network-changed-a38e6e53-8223-4e6d-b1e8-5fcdf9460891. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] Acquiring lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] Acquired lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Refreshing network info cache for port a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updated VIF entry in instance network info cache for port a38e6e53-8223-4e6d-b1e8-5fcdf9460891. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updating instance_info_cache with network_info: [{"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:07:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3cd1662c-8050-4619-8ff8-45c9ec1d3de9 req-691b5931-2579-4be8-8aa5-a56b38493777 service nova] Releasing lock "refresh_cache-f91ffe95-1dd6-40f9-b66c-e32c2741209b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:07:56 user nova-compute[74319]: WARNING nova.compute.manager [req-6d1ae802-e5cc-40b9-bc88-06836d890c77 req-eb2d122c-c26b-4d5c-9e3e-81f31e28527d service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:07:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:07:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance spawned successfully.
Oct 30 14:07:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:07:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2389f8b4-300b-4041-b342-77d7c9765c38 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 34.626s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:07:58 user nova-compute[74319]: INFO nova.compute.manager [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attaching volume b194d2b9-20db-40e5-9675-9727512089ff to /dev/vdc
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.utils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a34d56-c1c0-42ef-85d3-97ba81e27b38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[998054c3-e6d5-4e75-aea1-fee2cb79d0ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37419db-2d5b-4d5d-804e-8a31116b368d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d991620-0d84-489d-9464-82af54f9f52e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:07:58 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:07:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf309f-32c0-41bc-958a-d99ac2b36028]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG os_brick.utils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:07:58 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating existing volume attachment record: eb75f2f4-9b1f-4f86-b638-5966d5c70985 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:00 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:00 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:00 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f20715c-ff63-4df3-8806-59f31cb96a3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:08:00 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ff164-8695-464e-9b3a-e08026c2ad89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265] added
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1122d2-2516-4667-9507-70c8a81aef9f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96f077-7e87-4f5f-b1bf-907f77879bad]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknTwLeJ {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknTwLeJ" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ed1124-dd48-4cc0-886f-5b862060b97e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zknTwLeJ'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3097f-d2bb-4bc5-b1c4-6361b68b3fd6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[418867ce-eccd-41b7-9505-5eb5efa9b21f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ddf5a-120c-4095-820e-9aee725b49e2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]
Oct 30 14:08:00 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[470be997-2c60-4658-85a9-bc78a13360b6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4adf1ae-eee4-49b2-a140-13173e530bb9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:00 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[672bcada-bf6c-4096-a611-adb9ba24b986]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:08:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:01 user nova-compute[74319]: INFO nova.compute.manager [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Attaching volume 7000f133-c665-4428-82c3-f11cc04ba6b0 to /dev/vdb
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d71ce-eb23-494c-8e28-64518186f42c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1857eaa8-361e-42a8-b7f2-61a702146a27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed191e-70c0-439d-a258-b196e16ac1a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d815825-02a5-4828-a446-5dcc90d800a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23438303432356665', 'path': '/dev/sdf'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438303432356665', 'path': '/dev/sdf'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:08:01 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:08:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb540ad3-03bf-4803-9ac4-63ce82046831]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updating existing volume attachment record: 1064cf55-2787-49c7-a270-08a1a3b3bf4b {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:08:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:08:01 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:01 user nova-compute[74319]:   <source dev="/dev/sdf"/>
Oct 30 14:08:01 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:08:01 user nova-compute[74319]:   <serial>8e43d91d-336f-4c3b-8572-51860e6b6265</serial>
Oct 30 14:08:01 user nova-compute[74319]: </disk>
Oct 30 14:08:01 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:08:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No VIF found with MAC fa:16:3e:1e:90:5f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:08:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-635be539-291b-48c0-9369-c10541244c5e tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.748s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:08:03 user nova-compute[74319]: WARNING nova.compute.manager [req-00361638-9385-4173-9690-7d38b8f2db9b req-8b2e77eb-3a5a-46b9-9419-4710c123f710 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state active and task_state powering-off.
Oct 30 14:08:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance destroyed successfully.
Oct 30 14:08:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:08:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3af5aeb3-a588-4391-9bef-94eca6efcca0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.887s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:08:05 user nova-compute[74319]: WARNING nova.compute.manager [req-b19ab171-2443-4f2e-bd1c-2a3dc0fdb558 req-8b919832-7826-4e3f-99b1-4ebdd63546d7 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state stopped and task_state None.
Oct 30 14:08:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjByDKsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:22 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:22 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:22 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d935b6f4-039a-4441-b6af-9147976a887c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:08:22 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[063deaf9-db25-4748-8e90-fc8f589b55d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0] added
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9325f15a-844a-438b-915b-f33335724d85]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee9d86e-4cc3-475f-80f9-f664b5ed9858]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjByDKsa {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjByDKsa" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[547292f7-8bf5-4125-a934-eac41ecbdbf9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjByDKsa'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e09ed2-686f-429a-b26e-c5e1823e1339]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1c443c-17cb-48e9-8533-917b0508b6b9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d184f1de-359d-4333-993f-5e8faeb81316]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260]
Oct 30 14:08:22 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260] successful.
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882c006-a3a7-4c70-9fdf-40cf4a05bf0b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7faeeff8-52c9-47d8-b81e-b2dad4c7ae6f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[626343de-719e-46ba-8300-801de41528bb]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjByDKsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23966306332623730', 'path': '/dev/sdg'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966306332623730', 'path': '/dev/sdg'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:08:23 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:23 user nova-compute[74319]:   <source dev="/dev/sdg"/>
Oct 30 14:08:23 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:08:23 user nova-compute[74319]:   <serial>7000f133-c665-4428-82c3-f11cc04ba6b0</serial>
Oct 30 14:08:23 user nova-compute[74319]: </disk>
Oct 30 14:08:23 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] No VIF found with MAC fa:16:3e:88:8f:3c, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:08:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9c7d356b-facb-44a0-a5c6-72870180759b tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.658s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:25 user nova-compute[74319]: INFO nova.compute.manager [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Detaching volume 7000f133-c665-4428-82c3-f11cc04ba6b0
Oct 30 14:08:25 user nova-compute[74319]: INFO nova.virt.block_device [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Attempting to driver detach volume 7000f133-c665-4428-82c3-f11cc04ba6b0 from mountpoint /dev/vdb
Oct 30 14:08:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Attempting to detach device vdb from instance f91ffe95-1dd6-40f9-b66c-e32c2741209b from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:08:25 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:25 user nova-compute[74319]:   <source dev="/dev/sdg"/>
Oct 30 14:08:25 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:08:25 user nova-compute[74319]:   <serial>7000f133-c665-4428-82c3-f11cc04ba6b0</serial>
Oct 30 14:08:25 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:08:25 user nova-compute[74319]: </disk>
Oct 30 14:08:25 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:08:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance f91ffe95-1dd6-40f9-b66c-e32c2741209b from the persistent domain config.
Oct 30 14:08:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f91ffe95-1dd6-40f9-b66c-e32c2741209b from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:08:25 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:25 user nova-compute[74319]:   <source dev="/dev/sdg"/>
Oct 30 14:08:25 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:08:25 user nova-compute[74319]:   <serial>7000f133-c665-4428-82c3-f11cc04ba6b0</serial>
Oct 30 14:08:25 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:08:25 user nova-compute[74319]: </disk>
Oct 30 14:08:25 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuxclWDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:28 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:28 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:28 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ed609f-1a0c-4750-8547-718a22e1f1ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:08:28 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[50542016-683c-4958-afb7-650020f7b178]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff] added
Oct 30 14:08:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12838d2-26fb-4a21-b8da-1bfece795083]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bedcde-a1b1-4e84-9f4c-18ffb8818dd4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuxclWDX {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CuxclWDX" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb8aaef-188d-4c83-aac9-1eba4d3692ae]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CuxclWDX'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dda3fe-d517-4788-8684-db9caf01a276]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[03703cf1-a38d-4ae8-afdb-65206bb94079]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:28 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7e5807-f53b-4d4d-81f8-2f1fb51511c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260]
Oct 30 14:08:29 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260] successful.
Oct 30 14:08:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df81520e-e440-435c-b7a1-bcdc9e21420d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ceae59-e93c-46f9-a118-18e7b5b769f8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:29 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:29 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] HCTL ('39', '-', '-', 0) found on session 27 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc71c24-c64f-4813-83d9-605e291d112a]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Searching for a device in session 27 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuxclWDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:08:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23365366537626237', 'path': '/dev/sdh'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365366537626237', 'path': '/dev/sdh'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:08:30 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:30 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 14:08:30 user nova-compute[74319]:   <target dev="vdc" bus="virtio"/>
Oct 30 14:08:30 user nova-compute[74319]:   <serial>b194d2b9-20db-40e5-9675-9727512089ff</serial>
Oct 30 14:08:30 user nova-compute[74319]: </disk>
Oct 30 14:08:30 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] No VIF found with MAC fa:16:3e:5a:45:a6, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4107c0d5-b7ff-46fa-a27b-9c0541d56392 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 32.517s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:08:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:08:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7793MB free_disk=25.185874938964844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f91ffe95-1dd6-40f9-b66c-e32c2741209b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:31 user nova-compute[74319]: INFO nova.compute.manager [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Detaching volume b194d2b9-20db-40e5-9675-9727512089ff
Oct 30 14:08:31 user nova-compute[74319]: INFO nova.virt.block_device [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attempting to driver detach volume b194d2b9-20db-40e5-9675-9727512089ff from mountpoint /dev/vdc
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Attempting to detach device vdc from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:08:31 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:31 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 14:08:31 user nova-compute[74319]:   <target dev="vdc" bus="virtio"/>
Oct 30 14:08:31 user nova-compute[74319]:   <serial>b194d2b9-20db-40e5-9675-9727512089ff</serial>
Oct 30 14:08:31 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 14:08:31 user nova-compute[74319]: </disk>
Oct 30 14:08:31 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:08:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully detached device vdc from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the persistent domain config.
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:08:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:08:31 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:08:31 user nova-compute[74319]:   <source dev="/dev/sdh"/>
Oct 30 14:08:31 user nova-compute[74319]:   <target dev="vdc" bus="virtio"/>
Oct 30 14:08:31 user nova-compute[74319]:   <serial>b194d2b9-20db-40e5-9675-9727512089ff</serial>
Oct 30 14:08:31 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 30 14:08:31 user nova-compute[74319]: </disk>
Oct 30 14:08:31 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:08:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:08:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:08:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:36 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:08:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:45 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f91ffe95-1dd6-40f9-b66c-e32c2741209b is timed out.
Oct 30 14:08:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully detached device vdb from instance f91ffe95-1dd6-40f9-b66c-e32c2741209b from the live domain config.
Oct 30 14:08:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:08:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjByDKsa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:45 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aac08d0-851d-4dc2-9947-6f7a96231606]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:08:46 user nova-compute[74319]: No targets found.
Oct 30 14:08:46 user nova-compute[74319]: iSNS:
Oct 30 14:08:46 user nova-compute[74319]: No targets found.
Oct 30 14:08:46 user nova-compute[74319]: STATIC:
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff
Oct 30 14:08:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:46 user nova-compute[74319]: FIRMWARE:
Oct 30 14:08:46 user nova-compute[74319]: No targets found.
Oct 30 14:08:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:08:46 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:08:46 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade27ceb-f76f-4c9a-9fb1-54a9ee6847f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bb4d98-5026-41d9-9634-29308ac42348]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 (non-flash)
Oct 30 14:08:46 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974516b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0'): ({'sdg'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Removing single pathed devices sdg {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bb7488-a7ac-4930-803d-8a63ad0180a8]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7241217b-8ac5-4c50-9e2d-d726fc41a58f]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Flushing IO for device /dev/sdg {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee326a4-aaac-4b53-829e-c1ba4f095bd3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b49d34-684c-4a89-b7f7-a365a594a6c1]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] SCSI volumes sdg have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[beeb470f-4213-46e1-baea-ceb19f2b0b7f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1b36b-66b2-419d-8ac8-d8d1366ed487]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260]
Oct 30 14:08:46 user nova-compute[74319]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0, portal: 172.16.0.220,3260] successful.
Oct 30 14:08:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7000f133-c665-4428-82c3-f11cc04ba6b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[80541929-bbef-4fe4-9782-8b00453f53e8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] <== disconnect_volume: return (309ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:08:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'flavor' on Instance uuid f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7623a43e-9b38-4d6a-90fb-1a878e16ec02 tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.798s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:52 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 is timed out.
Oct 30 14:08:52 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully detached device vdc from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the live domain config.
Oct 30 14:08:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CuxclWDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:08:52 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec73dd94-6f68-490d-a5d2-9c704af81601]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:08:52 user nova-compute[74319]: No targets found.
Oct 30 14:08:52 user nova-compute[74319]: iSNS:
Oct 30 14:08:52 user nova-compute[74319]: No targets found.
Oct 30 14:08:52 user nova-compute[74319]: STATIC:
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff
Oct 30 14:08:52 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:08:52 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:08:52 user nova-compute[74319]: FIRMWARE:
Oct 30 14:08:52 user nova-compute[74319]: No targets found.
Oct 30 14:08:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:08:52 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:08:52 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a810241f-601b-4ebc-8b03-b0bcd91f4842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac2d847-afe4-4244-8569-eeef028e27f6]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:08:52 user nova-compute[74319]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff (non-flash)
Oct 30 14:08:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998674430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff'): ({'sdh'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Removing single pathed devices sdh {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ec16f3-8b61-4d3b-8b28-ef2026ba0898]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6f8d11-7a08-49f0-b3a2-c9b647c0d1ff]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Flushing IO for device /dev/sdh {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b431c55c-1b24-4742-8f89-84ba7577c2dd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[933280b0-428a-4ec5-ab95-744f6f13e6c7]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] SCSI volumes sdh have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[146e4111-a7bd-403f-8b31-ce0c5f275d36]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a3bae-9200-4a03-8437-9a62a34cae4b]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260]
Oct 30 14:08:52 user nova-compute[74319]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff, portal: 172.16.0.220,3260] successful.
Oct 30 14:08:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b194d2b9-20db-40e5-9675-9727512089ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b071d7d-3edd-4d86-a621-ca753bf71400]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== disconnect_volume: return (307ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:08:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:08:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:08:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c9026104-14bc-48f1-87b3-7a13ac32c5ad tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.849s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:58 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:08:58 user nova-compute[74319]: INFO nova.compute.claims [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Claim successful on node user
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:08:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.policy [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7aa0d23b06429a979030bc57f68027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304f9766008483988dba2ef27b88eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:08:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Creating image(s)
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "/opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "/opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk 1073741824" returned: 0 in 0.131s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:08:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Successfully created port: 1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.206s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Cannot resize image /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Ensure instance console log exists: /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Successfully updated port: 1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquired lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-changed-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Refreshing instance network info cache due to event network-changed-1935da15-1812-430c-b6d7-618a069e2915. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] Acquiring lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updating instance_info_cache with network_info: [{"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Releasing lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Instance network_info: |[{"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] Acquired lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Refreshing network info cache for port 1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Start _get_guest_xml network_info=[{"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:09:01 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:01 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-159810967',display_name='tempest-VolumesSnapshotTestJSON-instance-159810967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-159810967',id=27,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF81GjISoDrlIgoUhfcY9MzAexv7kixyNEkjE/ySNAaGDjCiNXW2+lMp2wYJnTEGY8w17L4dZpjUTT1ICWxGKvJ8sUntScZsJmGSuMSngcrKBzWlcOCdyljuF3A5hqjRQ==',key_name='tempest-keypair-1272234590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-8sbmzetk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=83ed38ff-887e-45b1-ae1e-ba0e004a30ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:09:01 user nova-compute[74319]:   <uuid>83ed38ff-887e-45b1-ae1e-ba0e004a30ef</uuid>
Oct 30 14:09:01 user nova-compute[74319]:   <name>instance-0000001b</name>
Oct 30 14:09:01 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:09:01 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:09:01 user nova-compute[74319]:   <metadata>
Oct 30 14:09:01 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:09:01 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-159810967</nova:name>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:09:01</nova:creationTime>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:09:01 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:09:01 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:owner>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:user uuid="0c7aa0d23b06429a979030bc57f68027">tempest-VolumesSnapshotTestJSON-1843196762-project-member</nova:user>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:project uuid="e304f9766008483988dba2ef27b88eb6">tempest-VolumesSnapshotTestJSON-1843196762</nova:project>
Oct 30 14:09:01 user nova-compute[74319]:       </nova:owner>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:09:01 user nova-compute[74319]:       <nova:ports>
Oct 30 14:09:01 user nova-compute[74319]:         <nova:port uuid="1935da15-1812-430c-b6d7-618a069e2915">
Oct 30 14:09:01 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 14:09:01 user nova-compute[74319]:         </nova:port>
Oct 30 14:09:01 user nova-compute[74319]:       </nova:ports>
Oct 30 14:09:01 user nova-compute[74319]:     </nova:instance>
Oct 30 14:09:01 user nova-compute[74319]:   </metadata>
Oct 30 14:09:01 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:09:01 user nova-compute[74319]:     <system>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="serial">83ed38ff-887e-45b1-ae1e-ba0e004a30ef</entry>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="uuid">83ed38ff-887e-45b1-ae1e-ba0e004a30ef</entry>
Oct 30 14:09:01 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:09:01 user nova-compute[74319]:     </system>
Oct 30 14:09:01 user nova-compute[74319]:   </sysinfo>
Oct 30 14:09:01 user nova-compute[74319]:   <os>
Oct 30 14:09:01 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:09:01 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:09:01 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:09:01 user nova-compute[74319]:   </os>
Oct 30 14:09:01 user nova-compute[74319]:   <features>
Oct 30 14:09:01 user nova-compute[74319]:     <acpi/>
Oct 30 14:09:01 user nova-compute[74319]:     <apic/>
Oct 30 14:09:01 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:09:01 user nova-compute[74319]:   </features>
Oct 30 14:09:01 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:09:01 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:09:01 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:09:01 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:09:01 user nova-compute[74319]:   </clock>
Oct 30 14:09:01 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:09:01 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:09:01 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:09:01 user nova-compute[74319]:   </cpu>
Oct 30 14:09:01 user nova-compute[74319]:   <devices>
Oct 30 14:09:01 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:09:01 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:09:01 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk"/>
Oct 30 14:09:01 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:09:01 user nova-compute[74319]:     </disk>
Oct 30 14:09:01 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:09:01 user nova-compute[74319]:       <mac address="fa:16:3e:39:76:be"/>
Oct 30 14:09:01 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:01 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:09:01 user nova-compute[74319]:       <target dev="tap1935da15-18"/>
Oct 30 14:09:01 user nova-compute[74319]:     </interface>
Oct 30 14:09:01 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:09:01 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/console.log" append="off"/>
Oct 30 14:09:01 user nova-compute[74319]:     </serial>
Oct 30 14:09:01 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:09:01 user nova-compute[74319]:     <video>
Oct 30 14:09:01 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:01 user nova-compute[74319]:     </video>
Oct 30 14:09:01 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:09:01 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:09:01 user nova-compute[74319]:     </rng>
Oct 30 14:09:01 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:09:01 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:09:01 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:09:01 user nova-compute[74319]:     </memballoon>
Oct 30 14:09:01 user nova-compute[74319]:   </devices>
Oct 30 14:09:01 user nova-compute[74319]: </domain>
Oct 30 14:09:01 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-159810967',display_name='tempest-VolumesSnapshotTestJSON-instance-159810967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-159810967',id=27,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF81GjISoDrlIgoUhfcY9MzAexv7kixyNEkjE/ySNAaGDjCiNXW2+lMp2wYJnTEGY8w17L4dZpjUTT1ICWxGKvJ8sUntScZsJmGSuMSngcrKBzWlcOCdyljuF3A5hqjRQ==',key_name='tempest-keypair-1272234590',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-8sbmzetk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:08:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=83ed38ff-887e-45b1-ae1e-ba0e004a30ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG os_vif [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dab9f8b6-3494-5328-9ab4-6e3a0616e827', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1935da15-18, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1935da15-18, col_values=(('qos', UUID('c9fa52aa-9cc6-49ad-84b2-a3334af9ae88')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1935da15-18, col_values=(('external_ids', {'iface-id': '1935da15-1812-430c-b6d7-618a069e2915', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:76:be', 'vm-uuid': '83ed38ff-887e-45b1-ae1e-ba0e004a30ef'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:01 user nova-compute[74319]: INFO os_vif [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18')
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No VIF found with MAC fa:16:3e:39:76:be, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updated VIF entry in instance network info cache for port 1935da15-1812-430c-b6d7-618a069e2915. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updating instance_info_cache with network_info: [{"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16f86e14-3ee6-4b36-bb52-1a60b2ef184e req-d22bdb47-1439-4a72-8237-a97f958dc281 service nova] Releasing lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] No waiting events found dispatching network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:02 user nova-compute[74319]: WARNING nova.compute.manager [req-80ddfd12-4fd6-4bd9-a981-3de42e9102c5 req-23fb912b-e49b-497f-b36e-842b9d34c335 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received unexpected event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 for instance with vm_state building and task_state spawning.
Oct 30 14:09:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:09:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Instance spawned successfully.
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:04 user nova-compute[74319]: INFO nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 30 14:09:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] No waiting events found dispatching network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:05 user nova-compute[74319]: WARNING nova.compute.manager [req-410fa4d3-5c5d-4136-be1e-408d60c03b6b req-70e32768-8e0f-48cd-a245-3e1a3d00a703 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received unexpected event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 for instance with vm_state building and task_state spawning.
Oct 30 14:09:05 user nova-compute[74319]: INFO nova.compute.manager [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Took 6.52 seconds to build instance.
Oct 30 14:09:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4b55ddae-9055-477a-8b92-978ad2bad333 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.635s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:12 user nova-compute[74319]: INFO nova.compute.manager [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Detaching volume 7a9403c4-fe98-45dd-b6b2-034cca44423d
Oct 30 14:09:12 user nova-compute[74319]: INFO nova.virt.block_device [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Attempting to driver detach volume 7a9403c4-fe98-45dd-b6b2-034cca44423d from mountpoint /dev/vdc
Oct 30 14:09:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Attempting to detach device vdc from instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:09:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:12 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:12 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:09:12 user nova-compute[74319]:   <target dev="vdc" bus="virtio"/>
Oct 30 14:09:12 user nova-compute[74319]:   <serial>7a9403c4-fe98-45dd-b6b2-034cca44423d</serial>
Oct 30 14:09:12 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:09:12 user nova-compute[74319]: </disk>
Oct 30 14:09:12 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully detached device vdc from instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 from the persistent domain config.
Oct 30 14:09:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:09:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:12 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:12 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:09:12 user nova-compute[74319]:   <target dev="vdc" bus="virtio"/>
Oct 30 14:09:12 user nova-compute[74319]:   <serial>7a9403c4-fe98-45dd-b6b2-034cca44423d</serial>
Oct 30 14:09:12 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:09:12 user nova-compute[74319]: </disk>
Oct 30 14:09:12 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:14 user nova-compute[74319]: INFO nova.compute.manager [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Terminating instance
Oct 30 14:09:14 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-unplugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] No waiting events found dispatching network-vif-unplugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-9d603367-654b-4482-9b04-6e67e8664088 req-0044c939-b884-44be-a26b-67e00e4627d2 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-unplugged-4b938e82-d39b-4642-ad79-ebcfaa828675 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Instance destroyed successfully.
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lazy-loading 'resources' on Instance uuid 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-855866068',display_name='tempest-ServersNegativeTestJSON-server-855866068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-855866068',id=13,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:00:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fea0328481b34a30ab78698c9815c6f5',ramdisk_id='',reservation_id='r-qu6gqtxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1299330642',owner_user_name='tempest-ServersNegativeTestJSON-1299330642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:00:13Z,user_data=None,user_id='24eece1d8fbe4be482f6afc140f0b2fa',uuid=5a08d5cb-f77c-46be-b0b8-5221c9f9ed32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converting VIF {"id": "4b938e82-d39b-4642-ad79-ebcfaa828675", "address": "fa:16:3e:26:30:5f", "network": {"id": "c34dbf95-67a4-416f-9ed9-71faa87819cb", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-150008010-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fea0328481b34a30ab78698c9815c6f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b938e82-d3", "ovs_interfaceid": "4b938e82-d39b-4642-ad79-ebcfaa828675", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG os_vif [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b938e82-d3, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac2e74f3-07e7-41ed-b17f-3ec0d96764ed) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: INFO os_vif [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:30:5f,bridge_name='br-int',has_traffic_filtering=True,id=4b938e82-d39b-4642-ad79-ebcfaa828675,network=Network(c34dbf95-67a4-416f-9ed9-71faa87819cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b938e82-d3')
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Deleting instance files /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32_del
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Deletion of /opt/stack/data/nova/instances/5a08d5cb-f77c-46be-b0b8-5221c9f9ed32_del complete
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.compute.manager [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.compute.manager [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Terminating instance
Oct 30 14:09:15 user nova-compute[74319]: DEBUG nova.compute.manager [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:09:15 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Took 0.66 seconds to deallocate network for instance.
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-unplugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] No waiting events found dispatching network-vif-unplugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-5a0f9e07-17fd-4439-b662-1a758aed7d00 req-58423b8f-51c8-4d93-89a1-98c30894870f service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-unplugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:16 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Deleted allocations for instance 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c2acdc6b-968f-4681-be0c-09414e7ca92e tempest-ServersNegativeTestJSON-1299330642 tempest-ServersNegativeTestJSON-1299330642-project-member] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Instance destroyed successfully.
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.objects.instance [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lazy-loading 'resources' on Instance uuid f91ffe95-1dd6-40f9-b66c-e32c2741209b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1427461180',display_name='tempest-AttachVolumeNegativeTest-server-1427461180',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1427461180',id=26,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCc9w7a9GSc6Y4gyxaPEr0POl9Pp2lwBK44QLXRMUnu3PLwEWgk4f136/ACXw1LRXSek1yijkBEuewN0V/KcrsO815CC132TvU7Sy9V+//1tInBUieMZay/Oi8IFawayWQ==',key_name='tempest-keypair-108150786',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:06:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ee6fce9483d048b580da3d18df44316d',ramdisk_id='',reservation_id='r-40y3v1ic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1763755820',owner_user_name='tempest-AttachVolumeNegativeTest-1763755820-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:06:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f860f101c5034c638821e668d33eeeff',uuid=f91ffe95-1dd6-40f9-b66c-e32c2741209b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converting VIF {"id": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "address": "fa:16:3e:88:8f:3c", "network": {"id": "2e14b030-3343-4bb1-b060-e97e29d2acf4", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1235907876-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ee6fce9483d048b580da3d18df44316d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa38e6e53-82", "ovs_interfaceid": "a38e6e53-8223-4e6d-b1e8-5fcdf9460891", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG os_vif [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa38e6e53-82, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11500796-e145-4e5b-a146-4e2e2d753c15) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:16 user nova-compute[74319]: INFO os_vif [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:8f:3c,bridge_name='br-int',has_traffic_filtering=True,id=a38e6e53-8223-4e6d-b1e8-5fcdf9460891,network=Network(2e14b030-3343-4bb1-b060-e97e29d2acf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa38e6e53-82')
Oct 30 14:09:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Deleting instance files /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b_del
Oct 30 14:09:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Deletion of /opt/stack/data/nova/instances/f91ffe95-1dd6-40f9-b66c-e32c2741209b_del complete
Oct 30 14:09:16 user nova-compute[74319]: INFO nova.compute.manager [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] Acquiring lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] Lock "5a08d5cb-f77c-46be-b0b8-5221c9f9ed32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] No waiting events found dispatching network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:16 user nova-compute[74319]: WARNING nova.compute.manager [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received unexpected event network-vif-plugged-4b938e82-d39b-4642-ad79-ebcfaa828675 for instance with vm_state deleted and task_state None.
Oct 30 14:09:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-9660518d-462f-40ef-ac11-c8bbc88d92bf req-311f18a8-6ea0-4719-8c6b-97f5831439a8 service nova] [instance: 5a08d5cb-f77c-46be-b0b8-5221c9f9ed32] Received event network-vif-deleted-4b938e82-d39b-4642-ad79-ebcfaa828675 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:17 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:17 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Took 0.86 seconds to deallocate network for instance.
Oct 30 14:09:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:17 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:09:17 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:09:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:17 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Deleted allocations for instance f91ffe95-1dd6-40f9-b66c-e32c2741209b
Oct 30 14:09:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-87fc5ed4-d6e3-4307-adff-5d2a2c14723c tempest-AttachVolumeNegativeTest-1763755820 tempest-AttachVolumeNegativeTest-1763755820-project-member] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] Acquiring lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] Lock "f91ffe95-1dd6-40f9-b66c-e32c2741209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] No waiting events found dispatching network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:18 user nova-compute[74319]: WARNING nova.compute.manager [req-8fc10c63-4f4c-466f-a74f-66f548f8017c req-fd827f75-ecee-49ef-974c-a7ec1fb8e0c8 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received unexpected event network-vif-plugged-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 for instance with vm_state deleted and task_state None.
Oct 30 14:09:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-f0880660-7e7e-4e48-add6-a841539264f2 req-f5d87b95-7d43-459f-9894-86fc5996e306 service nova] [instance: f91ffe95-1dd6-40f9-b66c-e32c2741209b] Received event network-vif-deleted-a38e6e53-8223-4e6d-b1e8-5fcdf9460891 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:22 user nova-compute[74319]: INFO nova.compute.manager [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Detaching volume 2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea
Oct 30 14:09:22 user nova-compute[74319]: INFO nova.virt.block_device [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Attempting to driver detach volume 2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea from mountpoint /dev/vdb
Oct 30 14:09:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Attempting to detach device vdb from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:09:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:22 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:22 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:09:22 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:09:22 user nova-compute[74319]:   <serial>2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea</serial>
Oct 30 14:09:22 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:09:22 user nova-compute[74319]: </disk>
Oct 30 14:09:22 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully detached device vdb from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the persistent domain config.
Oct 30 14:09:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:09:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:22 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:22 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:09:22 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:09:22 user nova-compute[74319]:   <serial>2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea</serial>
Oct 30 14:09:22 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:09:22 user nova-compute[74319]: </disk>
Oct 30 14:09:22 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG nova.objects.instance [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'flavor' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:23 user nova-compute[74319]: INFO nova.compute.manager [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attaching volume 24bd7549-7d66-46a0-a7ac-51359c2d41cb to /dev/vdb
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ddc38-60da-41b3-a60a-2c054c5486b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5785546a-7fc0-499a-bb48-3584cd074394]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f808711-7f78-428d-ad52-9945be9dccb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a47bac-da32-4e3f-9b29-638541efa57c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:09:23 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:09:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[073cb06b-8564-49f2-86ee-9123c9c918ff]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:23 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating existing volume attachment record: 9979564c-8fcb-493d-8ef6-489a4a374e33 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:09:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:24 user nova-compute[74319]: INFO nova.compute.manager [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Detaching volume 894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:09:24 user nova-compute[74319]: INFO nova.virt.block_device [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Attempting to driver detach volume 894bfe12-6152-4aa4-995a-760457cbd9e0 from mountpoint /dev/vdb
Oct 30 14:09:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Attempting to detach device vdb from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:09:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:24 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:24 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:09:24 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:09:24 user nova-compute[74319]:   <serial>894bfe12-6152-4aa4-995a-760457cbd9e0</serial>
Oct 30 14:09:24 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:09:24 user nova-compute[74319]: </disk>
Oct 30 14:09:24 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:24 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully detached device vdb from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the persistent domain config.
Oct 30 14:09:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:09:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:09:24 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:24 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:09:24 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:09:24 user nova-compute[74319]:   <serial>894bfe12-6152-4aa4-995a-760457cbd9e0</serial>
Oct 30 14:09:24 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:09:24 user nova-compute[74319]: </disk>
Oct 30 14:09:24 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:09:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:09:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:26 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:09:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:09:29 user nova-compute[74319]: INFO nova.compute.claims [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Claim successful on node user
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:09:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:09:29 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.policy [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a708010243464fe9bbf96c2e0e79a0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f2668e6b874840ad286ca9a8189fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:09:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Creating image(s)
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7910MB free_disk=25.211532592773438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Successfully created port: 3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk 1073741824" returned: 0 in 0.049s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Successfully updated port: 3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-changed-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Refreshing instance network info cache due to event network-changed-3dea0b00-08cc-4a00-8e19-83201a573774. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] Acquiring lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Cannot resize image /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Ensure instance console log exists: /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updating instance_info_cache with network_info: [{"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Instance network_info: |[{"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] Acquired lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Refreshing network info cache for port 3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Start _get_guest_xml network_info=[{"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:09:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249176932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249176932',id=28,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ji7a9obh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:09:30Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=6c5db4aa-4158-4870-8465-bf738b5e1b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.objects.instance [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c5db4aa-4158-4870-8465-bf738b5e1b30 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:09:31 user nova-compute[74319]:   <uuid>6c5db4aa-4158-4870-8465-bf738b5e1b30</uuid>
Oct 30 14:09:31 user nova-compute[74319]:   <name>instance-0000001c</name>
Oct 30 14:09:31 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:09:31 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:09:31 user nova-compute[74319]:   <metadata>
Oct 30 14:09:31 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:09:31 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-249176932</nova:name>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:09:31</nova:creationTime>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:09:31 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:09:31 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:owner>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:09:31 user nova-compute[74319]:       </nova:owner>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:09:31 user nova-compute[74319]:       <nova:ports>
Oct 30 14:09:31 user nova-compute[74319]:         <nova:port uuid="3dea0b00-08cc-4a00-8e19-83201a573774">
Oct 30 14:09:31 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:09:31 user nova-compute[74319]:         </nova:port>
Oct 30 14:09:31 user nova-compute[74319]:       </nova:ports>
Oct 30 14:09:31 user nova-compute[74319]:     </nova:instance>
Oct 30 14:09:31 user nova-compute[74319]:   </metadata>
Oct 30 14:09:31 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:09:31 user nova-compute[74319]:     <system>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="serial">6c5db4aa-4158-4870-8465-bf738b5e1b30</entry>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="uuid">6c5db4aa-4158-4870-8465-bf738b5e1b30</entry>
Oct 30 14:09:31 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:09:31 user nova-compute[74319]:     </system>
Oct 30 14:09:31 user nova-compute[74319]:   </sysinfo>
Oct 30 14:09:31 user nova-compute[74319]:   <os>
Oct 30 14:09:31 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:09:31 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:09:31 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:09:31 user nova-compute[74319]:   </os>
Oct 30 14:09:31 user nova-compute[74319]:   <features>
Oct 30 14:09:31 user nova-compute[74319]:     <acpi/>
Oct 30 14:09:31 user nova-compute[74319]:     <apic/>
Oct 30 14:09:31 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:09:31 user nova-compute[74319]:   </features>
Oct 30 14:09:31 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:09:31 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:09:31 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:09:31 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:09:31 user nova-compute[74319]:   </clock>
Oct 30 14:09:31 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:09:31 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:09:31 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:09:31 user nova-compute[74319]:   </cpu>
Oct 30 14:09:31 user nova-compute[74319]:   <devices>
Oct 30 14:09:31 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:09:31 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:09:31 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk"/>
Oct 30 14:09:31 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:09:31 user nova-compute[74319]:     </disk>
Oct 30 14:09:31 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:09:31 user nova-compute[74319]:       <mac address="fa:16:3e:46:49:83"/>
Oct 30 14:09:31 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:31 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:09:31 user nova-compute[74319]:       <target dev="tap3dea0b00-08"/>
Oct 30 14:09:31 user nova-compute[74319]:     </interface>
Oct 30 14:09:31 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:09:31 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/console.log" append="off"/>
Oct 30 14:09:31 user nova-compute[74319]:     </serial>
Oct 30 14:09:31 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:09:31 user nova-compute[74319]:     <video>
Oct 30 14:09:31 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:31 user nova-compute[74319]:     </video>
Oct 30 14:09:31 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:09:31 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:09:31 user nova-compute[74319]:     </rng>
Oct 30 14:09:31 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:09:31 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:09:31 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:09:31 user nova-compute[74319]:     </memballoon>
Oct 30 14:09:31 user nova-compute[74319]:   </devices>
Oct 30 14:09:31 user nova-compute[74319]: </domain>
Oct 30 14:09:31 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249176932',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249176932',id=28,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ji7a9obh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:09:30Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=6c5db4aa-4158-4870-8465-bf738b5e1b30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG os_vif [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9a5c926-d7a7-5eb9-a586-74f616229881', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dea0b00-08, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3dea0b00-08, col_values=(('qos', UUID('0d8a0312-32e7-402e-b69f-a64481a872ef')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3dea0b00-08, col_values=(('external_ids', {'iface-id': '3dea0b00-08cc-4a00-8e19-83201a573774', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:49:83', 'vm-uuid': '6c5db4aa-4158-4870-8465-bf738b5e1b30'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:31 user nova-compute[74319]: INFO os_vif [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08')
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:46:49:83, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updated VIF entry in instance network info cache for port 3dea0b00-08cc-4a00-8e19-83201a573774. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:09:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updating instance_info_cache with network_info: [{"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c1bab476-24e9-42e0-aaeb-979c063b8a28 req-2cbe5f9b-095d-423a-b51a-f2fbbfe0faa6 service nova] Releasing lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 is timed out.
Oct 30 14:09:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully detached device vdc from instance 00bf4369-a4dd-463a-ac55-12625d0a81a2 from the live domain config.
Oct 30 14:09:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HFvpWoOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:33 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30346a1d-79ad-4171-ad3a-588567ed9d5d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:09:33 user nova-compute[74319]: No targets found.
Oct 30 14:09:33 user nova-compute[74319]: iSNS:
Oct 30 14:09:33 user nova-compute[74319]: No targets found.
Oct 30 14:09:33 user nova-compute[74319]: STATIC:
Oct 30 14:09:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:09:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d
Oct 30 14:09:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea
Oct 30 14:09:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:09:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:33 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:09:33 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:33 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:33 user nova-compute[74319]: FIRMWARE:
Oct 30 14:09:33 user nova-compute[74319]: No targets found.
Oct 30 14:09:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:09:33 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:09:33 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacd7e9c-d8c2-4aac-a3df-9b29818ad04f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2722db1-b3e9-4071-a847-2afbf6ec6c35]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:09:33 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99869ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef690a40-4517-493f-804f-ea1e9f0b1dad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a65fae-fcf4-40dd-a644-e6ad3f4f114c]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d517a-9b6b-4e28-8a1d-b9e80a358a4f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] No waiting events found dispatching network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:33 user nova-compute[74319]: WARNING nova.compute.manager [req-78c0bb43-565e-48bf-a88c-bde42eb9bfa5 req-6575a5e5-81e7-4104-ad6b-0cab07964abc service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received unexpected event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 for instance with vm_state building and task_state spawning.
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93a1901-9ea8-4721-9685-ab1d1ec5c34a]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c4895-bf6b-43c3-b919-db7b74e45f41]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7d748-9b0a-4f08-8eaa-52ed6797a079]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260]
Oct 30 14:09:33 user nova-compute[74319]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a9403c4-fe98-45dd-b6b2-034cca44423d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d0bdc7-02ae-4460-8e1d-9aa55c937dd7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] <== disconnect_volume: return (343ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:09:34 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'flavor' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7c8d7e38-9108-42f4-8c01-1c7049f7d146 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:09:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Instance spawned successfully.
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:09:35 user nova-compute[74319]: INFO nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Took 5.16 seconds to spawn the instance on the hypervisor.
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:09:35 user nova-compute[74319]: INFO nova.compute.manager [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Took 6.04 seconds to build instance.
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] No waiting events found dispatching network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:35 user nova-compute[74319]: WARNING nova.compute.manager [req-bba1d731-805e-4052-8fc8-bdb438b997d0 req-7a0ff19a-6336-4d34-95a3-8c44925d26bd service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received unexpected event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 for instance with vm_state active and task_state None.
Oct 30 14:09:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-755801d3-5c00-4507-9f1a-af935946fb67 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.148s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:09:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:09:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:42 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 is timed out.
Oct 30 14:09:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully detached device vdb from instance 8c7acd12-fe23-479d-9ef2-5f4341b13267 from the live domain config.
Oct 30 14:09:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vbRloThH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff441ee-7f1d-474a-a526-d4ec236ed12a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:09:42 user nova-compute[74319]: No targets found.
Oct 30 14:09:42 user nova-compute[74319]: iSNS:
Oct 30 14:09:42 user nova-compute[74319]: No targets found.
Oct 30 14:09:42 user nova-compute[74319]: STATIC:
Oct 30 14:09:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:09:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea
Oct 30 14:09:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:09:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:42 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:09:42 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:42 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:42 user nova-compute[74319]: FIRMWARE:
Oct 30 14:09:42 user nova-compute[74319]: No targets found.
Oct 30 14:09:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:09:42 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:09:42 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.053s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5375b1-d917-4bd2-a280-7ab623dfa6c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[69022f3f-a0a1-49cc-b0f0-ff66113692e7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea (non-flash)
Oct 30 14:09:43 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998528940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac9c87-9d51-4908-84ce-4805647f0d28]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a371198b-b26f-4766-b2c5-95f2061e9fe9]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a09c6ab-ecd7-444c-8d8b-68a3b82dc087]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a43a65c-5919-491c-8b32-cb56d8c3c99a]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb3573-b6dc-43c0-9478-1db408b60d3f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc25605-becd-4462-b450-51af2f5cec45]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260]
Oct 30 14:09:43 user nova-compute[74319]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fc2e13f-8cec-4ad8-b71b-6c2cabfac7ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[35726fa9-85f4-457c-89b5-b68c1b306b2a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] <== disconnect_volume: return (342ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:43 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66e4536-15c9-46e0-ba9f-8402fca4f27a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:09:43 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4d7c5f-d1bb-48e8-990e-6911cfe0f95b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb] added
Oct 30 14:09:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[379aea7b-fe88-42ca-bed2-60dd4fc4652c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d299127f-03f7-42fb-9980-69655441d2cd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqgkJINF {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqgkJINF" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f3995b-19dc-4f67-bbc0-e3a4079681b1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XqgkJINF'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b15f938-e4cb-4433-8fb3-fc56ef3641ec]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5874d-220a-4a2b-8963-2aaf20c82a00]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4293a2e-1f8a-48de-bafb-fedc851948eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260]
Oct 30 14:09:44 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'flavor' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a472ac-6ce9-492e-b4b5-50e4b8f2fd68]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3fcd85-e7d8-49d7-ac5a-eac2bd3339a8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:44 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c58338eb-e464-4f49-b103-8f1decff2557 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.871s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5669dfe-cbbf-4400-aa24-d00fb87212e3]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:09:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23430323430666465', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430323430666465', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'flavor' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:45 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 is timed out.
Oct 30 14:09:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully detached device vdb from instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802 from the live domain config.
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:09:45 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:45 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:09:45 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:09:45 user nova-compute[74319]:   <serial>24bd7549-7d66-46a0-a7ac-51359c2d41cb</serial>
Oct 30 14:09:45 user nova-compute[74319]: </disk>
Oct 30 14:09:45 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvuRTexf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:45 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[16efaebb-865a-487c-b3e0-29c6e2eb0769]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:09:45 user nova-compute[74319]: No targets found.
Oct 30 14:09:45 user nova-compute[74319]: iSNS:
Oct 30 14:09:45 user nova-compute[74319]: No targets found.
Oct 30 14:09:45 user nova-compute[74319]: STATIC:
Oct 30 14:09:45 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:09:45 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:45 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:45 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:09:45 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:45 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:45 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0
Oct 30 14:09:45 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:45 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:45 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:09:45 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:45 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:45 user nova-compute[74319]: FIRMWARE:
Oct 30 14:09:45 user nova-compute[74319]: No targets found.
Oct 30 14:09:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:09:45 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:09:45 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d1cd7-544c-40df-b861-e6bd8b1c135f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e579ca-4029-48ca-bada-db3567e26b1c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:45 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99863ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c945bd1-7015-446d-b22f-348e41e30f3e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0802087d-06db-484f-af50-98ab47687b2a]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3a39ee-a937-43ea-bd02-ef83d1a7640e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[763289a3-1b25-499a-9498-733ae9705f16]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44b945-e69a-42fe-bf16-ddab1884f336]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df540b0-7d37-4d4d-9a2d-001456682b66]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260]
Oct 30 14:09:45 user nova-compute[74319]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:894bfe12-6152-4aa4-995a-760457cbd9e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ef5290-7a6a-4c6c-a0cd-b114d914c05e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== disconnect_volume: return (298ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No VIF found with MAC fa:16:3e:de:a1:bd, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:09:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-360d46af-8ae6-4d1a-810f-4ef26fdd8989 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.235s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:46 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'flavor' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0b15124c-ccc0-4608-aa29-0e94c3ca56a2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.787s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:46 user nova-compute[74319]: INFO nova.compute.manager [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Rescuing
Oct 30 14:09:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:09:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG nova.network.neutron [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:47 user nova-compute[74319]: WARNING nova.compute.manager [req-2ba3c407-1b84-4ff9-9436-c5992af24a1d req-fb6dfb62-38a2-48c4-b97f-08287991bb76 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state active and task_state rescuing.
Oct 30 14:09:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance destroyed successfully.
Oct 30 14:09:48 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attempting a stable device rescue
Oct 30 14:09:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:09:48 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Creating image(s)
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.part --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.virt.images [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] ae9c5129-b8b4-4474-91d9-8caee874e8f4 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.part /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.part /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.converted" returned: 0 in 0.336s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:49 user nova-compute[74319]: WARNING nova.compute.manager [req-39dbc9a8-9bdb-4db7-b2c9-fef179a0c79e req-6065a66d-be13-4a4d-ba25-3ccb80cf5256 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state active and task_state rescuing.
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.659s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2 --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2,backing_fmt=raw /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2,backing_fmt=raw /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue" returned: 0 in 0.066s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'migration_context' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.objects.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Object Instance<8a3f3e7c-2080-42c0-adf0-44e7734782a4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start _get_guest_xml network_info=[{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "vif_mac": "fa:16:3e:de:a1:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ae9c5129-b8b4-4474-91d9-8caee874e8f4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '9979564c-8fcb-493d-8ef6-489a4a374e33', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '8a3f3e7c-2080-42c0-adf0-44e7734782a4', 'attached_at': '', 'detached_at': '', 'volume_id': '24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'serial': '24bd7549-7d66-46a0-a7ac-51359c2d41cb'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'resources' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Object Instance<8a3f3e7c-2080-42c0-adf0-44e7734782a4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Object Instance<8a3f3e7c-2080-42c0-adf0-44e7734782a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Object Instance<8a3f3e7c-2080-42c0-adf0-44e7734782a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:50 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d997d5-4d9b-4ce0-a94f-c42fbc6a5f19]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XqgkJINF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 14:09:50 user nova-compute[74319]: node.name = iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:09:50 user nova-compute[74319]: node.tpgt = -1
Oct 30 14:09:50 user nova-compute[74319]: node.startup = automatic
Oct 30 14:09:50 user nova-compute[74319]: node.leading_login = No
Oct 30 14:09:50 user nova-compute[74319]: iface.iscsi_ifacename = default
Oct 30 14:09:50 user nova-compute[74319]: iface.net_ifacename = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.ipaddress = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.prefix_len = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.hwaddress = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.transport_name = tcp
Oct 30 14:09:50 user nova-compute[74319]: iface.initiatorname = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.vlan_id = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.vlan_priority = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.vlan_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.iface_num = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.mtu = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.port = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.bootproto = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.subnet_mask = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.gateway = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_alt_client_id = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_dns = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_learn_iqn = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_vendor_id_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_vendor_id = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.dhcp_slp_da = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.fragmentation = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.gratuitous_arp = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.incoming_forwarding = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.tos_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.tos = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.ttl = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.delayed_ack = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.tcp_nagle = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.tcp_wsf_state = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.tcp_wsf = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.tcp_timer_scale = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.tcp_timestamp = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.redirect = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.def_task_mgmt_timeout = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.header_digest = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.data_digest = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.immediate_data = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.initial_r2t = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.data_seq_inorder = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.data_pdu_inorder = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.erl = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.max_receive_data_len = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.first_burst_len = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.max_outstanding_r2t = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.max_burst_len = 0
Oct 30 14:09:50 user nova-compute[74319]: iface.chap_auth = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.bidi_chap = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.strict_login_compliance = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.discovery_auth = <empty>
Oct 30 14:09:50 user nova-compute[74319]: iface.discovery_logout = <empty>
Oct 30 14:09:50 user nova-compute[74319]: node.discovery_address = <empty>
Oct 30 14:09:50 user nova-compute[74319]: node.discovery_port = 0
Oct 30 14:09:50 user nova-compute[74319]: node.discovery_type = static
Oct 30 14:09:50 user nova-compute[74319]: node.session.initial_cmdsn = 0
Oct 30 14:09:50 user nova-compute[74319]: node.session.initial_login_retry_max = 8
Oct 30 14:09:50 user nova-compute[74319]: node.session.xmit_thread_priority = -20
Oct 30 14:09:50 user nova-compute[74319]: node.session.cmds_max = 128
Oct 30 14:09:50 user nova-compute[74319]: node.session.queue_depth = 32
Oct 30 14:09:50 user nova-compute[74319]: node.session.nr_sessions = 1
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.authmethod = CHAP
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.username = XqgkJINF
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.password = ***
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.username_in = <empty>
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.password_in = <empty>
Oct 30 14:09:50 user nova-compute[74319]: node.session.auth.chap_algs = MD5
Oct 30 14:09:50 user nova-compute[74319]: node.session.timeo.replacement_timeout = 120
Oct 30 14:09:50 user nova-compute[74319]: node.session.err_timeo.abort_timeout = 15
Oct 30 14:09:50 user nova-compute[74319]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 14:09:50 user nova-compute[74319]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 14:09:50 user nova-compute[74319]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.FastAbort = Yes
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.InitialR2T = No
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.ImmediateData = Yes
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.MaxConnections = 1
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 14:09:50 user nova-compute[74319]: node.session.iscsi.ERL = 0
Oct 30 14:09:50 user nova-compute[74319]: node.session.scan = manual
Oct 30 14:09:50 user nova-compute[74319]: node.session.reopen_max = 0
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].address = 172.16.0.220
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].port = 3260
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].startup = manual
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].tcp.window_size = 524288
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].tcp.type_of_service = 0
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].timeo.logout_timeout = 15
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].timeo.login_timeout = 15
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].timeo.auth_timeout = 45
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.DataDigest = None
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.IFMarker = No
Oct 30 14:09:50 user nova-compute[74319]: node.conn[0].iscsi.OFMarker = No
Oct 30 14:09:50 user nova-compute[74319]: # END RECORD
Oct 30 14:09:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce7a0b-4c41-4272-b1de-8b11d8dd9fce]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c433956-409a-495d-bb37-de89451adf3f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqgkJINF {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XqgkJINF" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e212b-9da4-4f0c-8289-0dbb07ac8596]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XqgkJINF'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9405f4e-828f-4ed0-8e80-1c77dc68fab6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4bfcbf-3e4f-4647-ac27-6fa4e8c42e2b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:50 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:50 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:50 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:50 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] HCTL ('35', '0', '0', 0) found on session 28 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a35b4c4-e19d-4685-9132-e4b381294b7f]: (4, ('0 0 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Searching for a device in session 28 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.156s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] <== connect_volume: return (157ms) {'type': 'block', 'scsi_wwn': '23430323430666465', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430323430666465', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586366234',display_name='tempest-ServerStableDeviceRescueTest-server-1586366234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586366234',id=23,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF507esoFzABrF72jsRukC2boVMp8hRTOhy8lzHqOUHI5qTLXU6bWt+8rqLzhikXkJtMS+VqXwM+/a7Wt8R0Oj0oj4Kbc/K6uYSVfAVJb0Zfvk/KAVZkLwNTYhYHvezfdg==',key_name='tempest-keypair-2014099519',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d27a717598b4f839ad4a9c12073b240',ramdisk_id='',reservation_id='r-0mg360fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-428345104',owner_user_name='tempest-ServerStableDeviceRescueTest-428345104-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4881f45201f94726bcf3cf5065c8afae',uuid=8a3f3e7c-2080-42c0-adf0-44e7734782a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "vif_mac": "fa:16:3e:de:a1:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converting VIF {"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "vif_mac": "fa:16:3e:de:a1:bd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Object Instance<8a3f3e7c-2080-42c0-adf0-44e7734782a4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:09:50 user nova-compute[74319]:   <uuid>8a3f3e7c-2080-42c0-adf0-44e7734782a4</uuid>
Oct 30 14:09:50 user nova-compute[74319]:   <name>instance-00000017</name>
Oct 30 14:09:50 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:09:50 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:09:50 user nova-compute[74319]:   <metadata>
Oct 30 14:09:50 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:09:50 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1586366234</nova:name>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:09:50</nova:creationTime>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:09:50 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:09:50 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:owner>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:user uuid="4881f45201f94726bcf3cf5065c8afae">tempest-ServerStableDeviceRescueTest-428345104-project-member</nova:user>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:project uuid="9d27a717598b4f839ad4a9c12073b240">tempest-ServerStableDeviceRescueTest-428345104</nova:project>
Oct 30 14:09:50 user nova-compute[74319]:       </nova:owner>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:09:50 user nova-compute[74319]:       <nova:ports>
Oct 30 14:09:50 user nova-compute[74319]:         <nova:port uuid="6130e6dd-5c0f-4e59-a446-eba9c5ab6ade">
Oct 30 14:09:50 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 30 14:09:50 user nova-compute[74319]:         </nova:port>
Oct 30 14:09:50 user nova-compute[74319]:       </nova:ports>
Oct 30 14:09:50 user nova-compute[74319]:     </nova:instance>
Oct 30 14:09:50 user nova-compute[74319]:   </metadata>
Oct 30 14:09:50 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:09:50 user nova-compute[74319]:     <system>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="serial">8a3f3e7c-2080-42c0-adf0-44e7734782a4</entry>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="uuid">8a3f3e7c-2080-42c0-adf0-44e7734782a4</entry>
Oct 30 14:09:50 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:09:50 user nova-compute[74319]:     </system>
Oct 30 14:09:50 user nova-compute[74319]:   </sysinfo>
Oct 30 14:09:50 user nova-compute[74319]:   <os>
Oct 30 14:09:50 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:09:50 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:09:50 user nova-compute[74319]:   </os>
Oct 30 14:09:50 user nova-compute[74319]:   <features>
Oct 30 14:09:50 user nova-compute[74319]:     <acpi/>
Oct 30 14:09:50 user nova-compute[74319]:     <apic/>
Oct 30 14:09:50 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:09:50 user nova-compute[74319]:   </features>
Oct 30 14:09:50 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:09:50 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:09:50 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:09:50 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:09:50 user nova-compute[74319]:   </clock>
Oct 30 14:09:50 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:09:50 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:09:50 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:09:50 user nova-compute[74319]:   </cpu>
Oct 30 14:09:50 user nova-compute[74319]:   <devices>
Oct 30 14:09:50 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:09:50 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:09:50 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk"/>
Oct 30 14:09:50 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:09:50 user nova-compute[74319]:     </disk>
Oct 30 14:09:50 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:09:50 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:50 user nova-compute[74319]:       <source dev="/dev/sdd"/>
Oct 30 14:09:50 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:09:50 user nova-compute[74319]:       <serial>24bd7549-7d66-46a0-a7ac-51359c2d41cb</serial>
Oct 30 14:09:50 user nova-compute[74319]:     </disk>
Oct 30 14:09:50 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:09:50 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:09:50 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue"/>
Oct 30 14:09:50 user nova-compute[74319]:       <target dev="vdc" bus="virtio"/>
Oct 30 14:09:50 user nova-compute[74319]:       <boot order="1"/>
Oct 30 14:09:50 user nova-compute[74319]:     </disk>
Oct 30 14:09:50 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:09:50 user nova-compute[74319]:       <mac address="fa:16:3e:de:a1:bd"/>
Oct 30 14:09:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:50 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:09:50 user nova-compute[74319]:       <target dev="tap6130e6dd-5c"/>
Oct 30 14:09:50 user nova-compute[74319]:     </interface>
Oct 30 14:09:50 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:09:50 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/console.log" append="off"/>
Oct 30 14:09:50 user nova-compute[74319]:     </serial>
Oct 30 14:09:50 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:09:50 user nova-compute[74319]:     <video>
Oct 30 14:09:50 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:50 user nova-compute[74319]:     </video>
Oct 30 14:09:50 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:09:50 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:09:50 user nova-compute[74319]:     </rng>
Oct 30 14:09:50 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:09:50 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:09:50 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:09:50 user nova-compute[74319]:     </memballoon>
Oct 30 14:09:50 user nova-compute[74319]:   </devices>
Oct 30 14:09:50 user nova-compute[74319]: </domain>
Oct 30 14:09:50 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:09:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance destroyed successfully.
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:09:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] No VIF found with MAC fa:16:3e:de:a1:bd, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:52 user nova-compute[74319]: WARNING nova.compute.manager [req-c2b02ace-0d08-4dba-b8e8-48afe1e4d5e3 req-31d8e759-f52f-497a-9ac4-37981b6f4c57 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state active and task_state rescuing.
Oct 30 14:09:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'info_cache' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-30e7df92-0f0f-4149-aa2e-a540351e74a2 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:54 user nova-compute[74319]: WARNING nova.compute.manager [req-0fd9f4ea-f655-43ea-9092-2101e7973a5f req-d5c89a6c-7d1a-4621-912d-41cacaab72eb service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state active and task_state rescuing.
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:09:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance destroyed successfully.
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'resources' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83bbef5-d6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6409b271-28b2-41fa-98df-b818079f48a0) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:54 user nova-compute[74319]: INFO os_vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdff2976-42fa-4600-9e7c-996b9a103bf6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:09:54 user nova-compute[74319]: No targets found.
Oct 30 14:09:54 user nova-compute[74319]: iSNS:
Oct 30 14:09:54 user nova-compute[74319]: No targets found.
Oct 30 14:09:54 user nova-compute[74319]: STATIC:
Oct 30 14:09:54 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:09:54 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:54 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:54 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:09:54 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:54 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:54 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:09:54 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:09:54 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:09:54 user nova-compute[74319]: FIRMWARE:
Oct 30 14:09:54 user nova-compute[74319]: No targets found.
Oct 30 14:09:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:09:54 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:09:54 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42c5926-dd4e-49eb-a169-d9f388e7c504]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd9bb89-334d-4092-8ddc-ead88ba8902f]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:54 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:54 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:54 user nova-compute[74319]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:54 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97465bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265'): ({'sdf'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Removing single pathed devices sdf {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[368273e1-5b11-4079-83dc-253eecee7323]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df7ba96-f69e-4e0e-8bcb-554cd83374c8]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flushing IO for device /dev/sdf {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d34dab7-006a-40b2-8275-89f963be0ad0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51f7e93-68dc-4c67-8188-ae2b46ef48f4]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b961d4a4-c8ac-4bd2-a70c-16816c1311e5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3313d07-33ee-465a-b60a-5f5859ce16d6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]
Oct 30 14:09:54 user nova-compute[74319]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fccf56-7c29-4543-a75a-cdcfed0635bc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== disconnect_volume: return (294ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start _get_guest_xml network_info=[{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '80f677b6-7632-40e0-8db1-ac9fc88f95ad', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '43fe7c9d-5a25-455b-8245-6028034d44a9', 'attached_at': '', 'detached_at': '', 'volume_id': '8e43d91d-336f-4c3b-8572-51860e6b6265', 'serial': '8e43d91d-336f-4c3b-8572-51860e6b6265'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'numa_topology' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:09:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:54 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:09:54 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a982edc-152c-438e-8d94-ce82831e3332]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:09:54 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc34db7-4311-4d89-afb6-c29f70edbce6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265] added
Oct 30 14:09:54 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ece3ad-0cc6-4d29-8a03-278f7a7bed9a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b93828-31b6-40ca-8115-55b73f36dbe1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknTwLeJ {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zknTwLeJ" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bd233a-039f-4354-82d5-7795a04442db]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zknTwLeJ'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a764b61a-5a41-4dd7-a681-bd29d0a7179e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3dc253-4e01-4a49-983f-e5f5a227e264]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:55 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:55 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdade97-c4ca-41b7-a855-cb708b23de72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]
Oct 30 14:09:55 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.
Oct 30 14:09:55 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5045c-87fa-4ffd-b2b1-0958342af1be]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a838a0-cdee-4075-a6d4-af5175753002]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:55 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:09:55 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:09:55 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5de488-5d0a-4ff8-8810-9e58cbd6a716]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:09:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23438303432356665', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438303432356665', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'pci_devices' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:09:56 user nova-compute[74319]:   <uuid>43fe7c9d-5a25-455b-8245-6028034d44a9</uuid>
Oct 30 14:09:56 user nova-compute[74319]:   <name>instance-00000019</name>
Oct 30 14:09:56 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:09:56 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:09:56 user nova-compute[74319]:   <metadata>
Oct 30 14:09:56 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:09:56 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeTestJSON-server-447137083</nova:name>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:09:54</nova:creationTime>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:09:56 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:09:56 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:owner>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:user uuid="521f59eb12f844b49a6a727ec38bd016">tempest-AttachVolumeTestJSON-636845633-project-member</nova:user>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:project uuid="42370e22b20540a6b4670bfcc02d62b6">tempest-AttachVolumeTestJSON-636845633</nova:project>
Oct 30 14:09:56 user nova-compute[74319]:       </nova:owner>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:09:56 user nova-compute[74319]:       <nova:ports>
Oct 30 14:09:56 user nova-compute[74319]:         <nova:port uuid="c83bbef5-d67d-4021-8153-e35b9019544e">
Oct 30 14:09:56 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:09:56 user nova-compute[74319]:         </nova:port>
Oct 30 14:09:56 user nova-compute[74319]:       </nova:ports>
Oct 30 14:09:56 user nova-compute[74319]:     </nova:instance>
Oct 30 14:09:56 user nova-compute[74319]:   </metadata>
Oct 30 14:09:56 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:09:56 user nova-compute[74319]:     <system>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="serial">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="uuid">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:09:56 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:09:56 user nova-compute[74319]:     </system>
Oct 30 14:09:56 user nova-compute[74319]:   </sysinfo>
Oct 30 14:09:56 user nova-compute[74319]:   <os>
Oct 30 14:09:56 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:09:56 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:09:56 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:09:56 user nova-compute[74319]:   </os>
Oct 30 14:09:56 user nova-compute[74319]:   <features>
Oct 30 14:09:56 user nova-compute[74319]:     <acpi/>
Oct 30 14:09:56 user nova-compute[74319]:     <apic/>
Oct 30 14:09:56 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:09:56 user nova-compute[74319]:   </features>
Oct 30 14:09:56 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:09:56 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:09:56 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:09:56 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:09:56 user nova-compute[74319]:   </clock>
Oct 30 14:09:56 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:09:56 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:09:56 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:09:56 user nova-compute[74319]:   </cpu>
Oct 30 14:09:56 user nova-compute[74319]:   <devices>
Oct 30 14:09:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:09:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:09:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk"/>
Oct 30 14:09:56 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:09:56 user nova-compute[74319]:     </disk>
Oct 30 14:09:56 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:09:56 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:09:56 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:09:56 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:09:56 user nova-compute[74319]:       <serial>8e43d91d-336f-4c3b-8572-51860e6b6265</serial>
Oct 30 14:09:56 user nova-compute[74319]:     </disk>
Oct 30 14:09:56 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:09:56 user nova-compute[74319]:       <mac address="fa:16:3e:1e:90:5f"/>
Oct 30 14:09:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:56 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:09:56 user nova-compute[74319]:       <target dev="tapc83bbef5-d6"/>
Oct 30 14:09:56 user nova-compute[74319]:     </interface>
Oct 30 14:09:56 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:09:56 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/console.log" append="off"/>
Oct 30 14:09:56 user nova-compute[74319]:     </serial>
Oct 30 14:09:56 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:09:56 user nova-compute[74319]:     <video>
Oct 30 14:09:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:09:56 user nova-compute[74319]:     </video>
Oct 30 14:09:56 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:09:56 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:09:56 user nova-compute[74319]:     </rng>
Oct 30 14:09:56 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:09:56 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:09:56 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:09:56 user nova-compute[74319]:     </memballoon>
Oct 30 14:09:56 user nova-compute[74319]:   </devices>
Oct 30 14:09:56 user nova-compute[74319]: </domain>
Oct 30 14:09:56 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Cannot resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'migration_context' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:09:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:08:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG os_vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3d476c-66a5-53c5-920b-03bf2e5c0ad7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83bbef5-d6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc83bbef5-d6, col_values=(('qos', UUID('7a139de4-5eb4-45b2-89ca-fd419d13a474')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc83bbef5-d6, col_values=(('external_ids', {'iface-id': 'c83bbef5-d67d-4021-8153-e35b9019544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:90:5f', 'vm-uuid': '43fe7c9d-5a25-455b-8245-6028034d44a9'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:09:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:57 user nova-compute[74319]: INFO os_vif [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:09:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:09:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:09:58 user nova-compute[74319]: WARNING nova.compute.manager [req-6bbbd781-0c62-41f3-aa3a-2f672e7b5466 req-64b3e72c-ef24-4982-bf16-a99dba03daba service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state stopped and task_state powering-on.
Oct 30 14:09:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:09:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:10:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance rebooted successfully.
Oct 30 14:10:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-71f2bfd0-1674-4229-b56e-4be5df3148b0 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:00 user nova-compute[74319]: WARNING nova.compute.manager [req-91736c19-4f97-4f69-9e8e-5ed13407bdc8 req-8dbddf0c-6cc3-4862-86df-8b463188c2ac service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state active and task_state None.
Oct 30 14:10:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:02 user nova-compute[74319]: INFO nova.compute.manager [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Terminating instance
Oct 30 14:10:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-24916946-2a7f-4d65-a72b-340b216fecc1 req-3791f0ca-9e60-4668-8916-c2b6983d3ccf service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-unplugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:10:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Instance destroyed successfully.
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'resources' on Instance uuid 00bf4369-a4dd-463a-ac55-12625d0a81a2 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:03:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-2051727474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-2051727474',id=19,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhnZsHN9yo6cWW7C3RXnaqTKtPxxMABjJ7Zf2j+Pt8HBXRqzqEHxAwf+igL3OWSUOKSZkHY8zq+H5wuv8nC2wg07izK4tJ8LKlG8O2/jrOhi06bvLBtPcwt8KKzSFD7dA==',key_name='tempest-keypair-1275219634',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:07:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0d20r07u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=00bf4369-a4dd-463a-ac55-12625d0a81a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "d4d45c22-1233-41d7-835a-23ff10d39344", "address": "fa:16:3e:39:2f:66", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4d45c22-12", "ovs_interfaceid": "d4d45c22-1233-41d7-835a-23ff10d39344", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG os_vif [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4d45c22-12, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af91e5dc-95f2-4282-b405-f5d3ac2629de) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:03 user nova-compute[74319]: INFO os_vif [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:2f:66,bridge_name='br-int',has_traffic_filtering=True,id=d4d45c22-1233-41d7-835a-23ff10d39344,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4d45c22-12')
Oct 30 14:10:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Deleting instance files /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2_del
Oct 30 14:10:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Deletion of /opt/stack/data/nova/instances/00bf4369-a4dd-463a-ac55-12625d0a81a2_del complete
Oct 30 14:10:03 user nova-compute[74319]: INFO nova.compute.manager [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 30 14:10:03 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:10:03 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:10:04 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:04 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Took 0.76 seconds to deallocate network for instance.
Oct 30 14:10:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-bfe5c268-3502-4ad1-95ac-5032d82f5c70 req-a8c22d8e-9135-4aa9-9622-28b936f266f7 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-deleted-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:05 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Deleted allocations for instance 00bf4369-a4dd-463a-ac55-12625d0a81a2
Oct 30 14:10:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-bd436ceb-5056-4632-9bc3-75f137462189 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] Acquiring lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] Lock "00bf4369-a4dd-463a-ac55-12625d0a81a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] No waiting events found dispatching network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:05 user nova-compute[74319]: WARNING nova.compute.manager [req-de4fe393-69de-4164-b427-909bd598bc9f req-eb0a0df3-998a-4588-bbb3-cd065a0bbe78 service nova] [instance: 00bf4369-a4dd-463a-ac55-12625d0a81a2] Received unexpected event network-vif-plugged-d4d45c22-1233-41d7-835a-23ff10d39344 for instance with vm_state deleted and task_state None.
Oct 30 14:10:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:12 user nova-compute[74319]: INFO nova.compute.manager [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Terminating instance
Oct 30 14:10:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-unplugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] No waiting events found dispatching network-vif-unplugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-d5cef7f9-6d99-4426-ad58-a461fc023c0b req-41483d3b-fca7-42c4-a0f2-124759e117c1 service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-unplugged-da3bbafe-404d-4006-9170-5b0f56485e8b for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Instance destroyed successfully.
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lazy-loading 'resources' on Instance uuid 8c7acd12-fe23-479d-9ef2-5f4341b13267 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-934157020',display_name='tempest-TestServerVolumeAttachmentScenario-server-934157020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-934157020',id=24,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH/lEqW3hVrCvucqOqrtNMApQ6cbEvFwTJUpSjmjz90uaC9WBz7tyUHspPwvXiU8EyMm6OZSFkQEXYDnZNl/sRvxeyx50CBpzEBkHsfXxQUehxgKH7LwZRLPc0I34pl20w==',key_name='tempest-keypair-1123506176',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc2f5e6e78694039ba6257f66fc7af85',ramdisk_id='',reservation_id='r-smh27rnh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-525935652',owner_user_name='tempest-TestServerVolumeAttachmentScenario-525935652-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1f3abf29ecb4ea8a86da936a555e164',uuid=8c7acd12-fe23-479d-9ef2-5f4341b13267,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converting VIF {"id": "da3bbafe-404d-4006-9170-5b0f56485e8b", "address": "fa:16:3e:5a:45:a6", "network": {"id": "80933114-bea0-43fa-94df-8a31b94c0aa6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1635072539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc2f5e6e78694039ba6257f66fc7af85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda3bbafe-40", "ovs_interfaceid": "da3bbafe-404d-4006-9170-5b0f56485e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG os_vif [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda3bbafe-40, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e048385-df9e-443f-8887-a82a765b7f1b) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:13 user nova-compute[74319]: INFO os_vif [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:45:a6,bridge_name='br-int',has_traffic_filtering=True,id=da3bbafe-404d-4006-9170-5b0f56485e8b,network=Network(80933114-bea0-43fa-94df-8a31b94c0aa6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda3bbafe-40')
Oct 30 14:10:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Deleting instance files /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267_del
Oct 30 14:10:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Deletion of /opt/stack/data/nova/instances/8c7acd12-fe23-479d-9ef2-5f4341b13267_del complete
Oct 30 14:10:13 user nova-compute[74319]: INFO nova.compute.manager [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 30 14:10:13 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:10:13 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:10:14 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:14 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Took 0.79 seconds to deallocate network for instance.
Oct 30 14:10:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-842943ec-9ec1-4ff5-b115-16c660fcb251 req-16e9f3e3-7707-4de4-b084-ca14d00f040c service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-deleted-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:15 user nova-compute[74319]: INFO nova.compute.manager [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Terminating instance
Oct 30 14:10:15 user nova-compute[74319]: DEBUG nova.compute.manager [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:15 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Deleted allocations for instance 8c7acd12-fe23-479d-9ef2-5f4341b13267
Oct 30 14:10:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] Acquiring lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] No waiting events found dispatching network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:15 user nova-compute[74319]: WARNING nova.compute.manager [req-c93be190-ee5e-46a6-a715-518bf919bce9 req-1e2d19cd-86ae-4682-a4a7-8283aa71bb1f service nova] [instance: 8c7acd12-fe23-479d-9ef2-5f4341b13267] Received unexpected event network-vif-plugged-da3bbafe-404d-4006-9170-5b0f56485e8b for instance with vm_state deleted and task_state None.
Oct 30 14:10:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fa9d8693-d2f4-498d-86fb-f896214be708 tempest-TestServerVolumeAttachmentScenario-525935652 tempest-TestServerVolumeAttachmentScenario-525935652-project-member] Lock "8c7acd12-fe23-479d-9ef2-5f4341b13267" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Instance destroyed successfully.
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.objects.instance [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'resources' on Instance uuid e386fa6a-5c77-4482-9bd7-4d3ef21cf802 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-986593302',display_name='tempest-ServerActionsTestOtherA-server-122720079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-986593302',id=21,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFM5q39r3fIh3hWm8X5uot2a7ZTLntcKFNCMOdjIqzFO7ui1m+Z0gqgGB5iGGng9evQ0kb/hzcHiWeyKwa3z1v1IWHQN9fIzrCRf//fYY76U+eiZtclW0D84axhJJuHC/w==',key_name='tempest-keypair-715324316',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:06:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-bo80yz2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:07:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=e386fa6a-5c77-4482-9bd7-4d3ef21cf802,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "2511e72f-9d7c-488f-9430-a33f351f40bb", "address": "fa:16:3e:d2:49:67", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2511e72f-9d", "ovs_interfaceid": "2511e72f-9d7c-488f-9430-a33f351f40bb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG os_vif [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2511e72f-9d, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eee21b98-b4ba-4aa8-b133-b3a9503f19a4) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:16 user nova-compute[74319]: INFO os_vif [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:49:67,bridge_name='br-int',has_traffic_filtering=True,id=2511e72f-9d7c-488f-9430-a33f351f40bb,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2511e72f-9d')
Oct 30 14:10:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Deleting instance files /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802_del
Oct 30 14:10:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Deletion of /opt/stack/data/nova/instances/e386fa6a-5c77-4482-9bd7-4d3ef21cf802_del complete
Oct 30 14:10:16 user nova-compute[74319]: INFO nova.compute.manager [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-unplugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Acquiring lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] No waiting events found dispatching network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:10:16 user nova-compute[74319]: WARNING nova.compute.manager [req-85eb863a-3b19-478c-b250-74288e6696c3 req-0190b63d-dd5f-4c6b-b62e-bc6973682108 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received unexpected event network-vif-plugged-2511e72f-9d7c-488f-9430-a33f351f40bb for instance with vm_state active and task_state deleting.
Oct 30 14:10:16 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Took 0.76 seconds to deallocate network for instance.
Oct 30 14:10:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:17 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:10:17 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:10:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:17 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Deleted allocations for instance e386fa6a-5c77-4482-9bd7-4d3ef21cf802
Oct 30 14:10:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-9f2ece9d-1221-44f9-8435-c8a7b698a178 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "e386fa6a-5c77-4482-9bd7-4d3ef21cf802" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.320s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-2b9cfbc7-8566-4df2-a32e-8c4a4fa010c9 req-ad9c704c-b356-4dc9-8783-96570825ac40 service nova] [instance: e386fa6a-5c77-4482-9bd7-4d3ef21cf802] Received event network-vif-deleted-2511e72f-9d7c-488f-9430-a33f351f40bb {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:10:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:10:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7847MB free_disk=25.16596221923828GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:10:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:10:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:36 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:10:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:10:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-changed-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Refreshing instance network info cache due to event network-changed-1935da15-1812-430c-b6d7-618a069e2915. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] Acquiring lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] Acquired lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG nova.network.neutron [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Refreshing network info cache for port 1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:10:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Ignoring supplied device name: /dev/vdb
Oct 30 14:10:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:50 user nova-compute[74319]: INFO nova.compute.manager [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Attaching volume 7ab02383-38b5-4372-a319-576ac57ccbd5 to /dev/vdb
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.utils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[20090b22-ee61-4428-8baf-e870542eecac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800d389-3fbc-4202-ad0c-9e713f2a3ea1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc467b-c89d-4f65-b711-57b4a8d88dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[34db8036-5d6d-45dc-a47d-ce3eca5b735d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:10:50 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7526723c-61c9-47e2-8de0-cdf96bfd089d]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG os_brick.utils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updating existing volume attachment record: 81e3c6fb-0410-43a4-95d7-e598f6364b98 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updated VIF entry in instance network info cache for port 1935da15-1812-430c-b6d7-618a069e2915. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updating instance_info_cache with network_info: [{"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-662fef82-2de2-4eda-8173-f3e032260337 req-262af919-edef-42fc-b949-452be7421e4d service nova] Releasing lock "refresh_cache-83ed38ff-887e-45b1-ae1e-ba0e004a30ef" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:10:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 7ce4683d-18d7-47cb-9f2e-15a53c528d82 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 6c5db4aa-4158-4870-8465-bf738b5e1b30 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:10:57 user nova-compute[74319]: INFO nova.compute.claims [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Claim successful on node user
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:10:57 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.policy [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72f5d276e62a472b92e46d28aa5a5286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e173b99e7da54c6688ccc9969dbaa7f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:10:57 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Creating image(s)
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.203s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk 1073741824" returned: 0 in 0.057s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Successfully created port: 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Cannot resize image /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Ensure instance console log exists: /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:10:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Successfully updated port: 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing instance network info cache due to event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance network_info: |[{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.neutron [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start _get_guest_xml network_info=[{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:10:59 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:10:59 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatiEjrg54c7ufpvCpKiN4N+7JgFt2H+65DC18ymT5sW2GL1SfP5+qZUO5niQ5l71gzOgdx5XEgvrJjBTO1u8NErc9qmP6xFqISZrllcnQB0umqah4auZaBqbCGR8wxtQ==',key_name='tempest-keypair-1424537780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_devices' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:10:59 user nova-compute[74319]:   <uuid>acbcf291-490e-454c-bed2-197e923d657e</uuid>
Oct 30 14:10:59 user nova-compute[74319]:   <name>instance-0000001d</name>
Oct 30 14:10:59 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:10:59 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:10:59 user nova-compute[74319]:   <metadata>
Oct 30 14:10:59 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:10:59 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1427360873</nova:name>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:10:59</nova:creationTime>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:10:59 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:10:59 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:owner>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:user uuid="72f5d276e62a472b92e46d28aa5a5286">tempest-AttachVolumeShelveTestJSON-282209841-project-member</nova:user>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:project uuid="e173b99e7da54c6688ccc9969dbaa7f4">tempest-AttachVolumeShelveTestJSON-282209841</nova:project>
Oct 30 14:10:59 user nova-compute[74319]:       </nova:owner>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:10:59 user nova-compute[74319]:       <nova:ports>
Oct 30 14:10:59 user nova-compute[74319]:         <nova:port uuid="7007b011-9b96-4a02-b69e-2e4b401fb2af">
Oct 30 14:10:59 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:10:59 user nova-compute[74319]:         </nova:port>
Oct 30 14:10:59 user nova-compute[74319]:       </nova:ports>
Oct 30 14:10:59 user nova-compute[74319]:     </nova:instance>
Oct 30 14:10:59 user nova-compute[74319]:   </metadata>
Oct 30 14:10:59 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:10:59 user nova-compute[74319]:     <system>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="serial">acbcf291-490e-454c-bed2-197e923d657e</entry>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="uuid">acbcf291-490e-454c-bed2-197e923d657e</entry>
Oct 30 14:10:59 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:10:59 user nova-compute[74319]:     </system>
Oct 30 14:10:59 user nova-compute[74319]:   </sysinfo>
Oct 30 14:10:59 user nova-compute[74319]:   <os>
Oct 30 14:10:59 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:10:59 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:10:59 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:10:59 user nova-compute[74319]:   </os>
Oct 30 14:10:59 user nova-compute[74319]:   <features>
Oct 30 14:10:59 user nova-compute[74319]:     <acpi/>
Oct 30 14:10:59 user nova-compute[74319]:     <apic/>
Oct 30 14:10:59 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:10:59 user nova-compute[74319]:   </features>
Oct 30 14:10:59 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:10:59 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:10:59 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:10:59 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:10:59 user nova-compute[74319]:   </clock>
Oct 30 14:10:59 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:10:59 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:10:59 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:10:59 user nova-compute[74319]:   </cpu>
Oct 30 14:10:59 user nova-compute[74319]:   <devices>
Oct 30 14:10:59 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:10:59 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:10:59 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk"/>
Oct 30 14:10:59 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:10:59 user nova-compute[74319]:     </disk>
Oct 30 14:10:59 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:10:59 user nova-compute[74319]:       <mac address="fa:16:3e:52:e6:ec"/>
Oct 30 14:10:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:10:59 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:10:59 user nova-compute[74319]:       <target dev="tap7007b011-9b"/>
Oct 30 14:10:59 user nova-compute[74319]:     </interface>
Oct 30 14:10:59 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:10:59 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/console.log" append="off"/>
Oct 30 14:10:59 user nova-compute[74319]:     </serial>
Oct 30 14:10:59 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:10:59 user nova-compute[74319]:     <video>
Oct 30 14:10:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:10:59 user nova-compute[74319]:     </video>
Oct 30 14:10:59 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:10:59 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:10:59 user nova-compute[74319]:     </rng>
Oct 30 14:10:59 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:10:59 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:10:59 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:10:59 user nova-compute[74319]:     </memballoon>
Oct 30 14:10:59 user nova-compute[74319]:   </devices>
Oct 30 14:10:59 user nova-compute[74319]: </domain>
Oct 30 14:10:59 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatiEjrg54c7ufpvCpKiN4N+7JgFt2H+65DC18ymT5sW2GL1SfP5+qZUO5niQ5l71gzOgdx5XEgvrJjBTO1u8NErc9qmP6xFqISZrllcnQB0umqah4auZaBqbCGR8wxtQ==',key_name='tempest-keypair-1424537780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:10:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG os_vif [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18203bd8-c56a-5662-ab1a-6440a19e26d1', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7007b011-9b, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7007b011-9b, col_values=(('qos', UUID('516a2da1-560d-4864-aaa6-7b589fd4d327')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7007b011-9b, col_values=(('external_ids', {'iface-id': '7007b011-9b96-4a02-b69e-2e4b401fb2af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:e6:ec', 'vm-uuid': 'acbcf291-490e-454c-bed2-197e923d657e'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:10:59 user nova-compute[74319]: INFO os_vif [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b')
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:10:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No VIF found with MAC fa:16:3e:52:e6:ec, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:11:00 user nova-compute[74319]: DEBUG nova.network.neutron [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updated VIF entry in instance network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:11:00 user nova-compute[74319]: DEBUG nova.network.neutron [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1906859b-872c-41fe-999f-72be77b7b777 req-63ff9f2f-74ae-4f68-bdd2-9e28eb3f345f service nova] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:01 user nova-compute[74319]: WARNING nova.compute.manager [req-27f28810-c938-4093-b558-439b358f9be5 req-b86614ae-7fdd-407d-970f-8ee75e65ea5e service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state building and task_state spawning.
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:03 user nova-compute[74319]: WARNING nova.compute.manager [req-07958ed3-755e-4d89-8ce8-d47a36d155c3 req-46503076-18d4-489f-b18d-62de6787de46 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state building and task_state spawning.
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:11:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance spawned successfully.
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:03 user nova-compute[74319]: INFO nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Took 5.80 seconds to spawn the instance on the hypervisor.
Oct 30 14:11:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:11:03 user nova-compute[74319]: INFO nova.compute.manager [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Took 6.52 seconds to build instance.
Oct 30 14:11:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-036bae74-871c-4106-b530-49556d9771cf tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.713s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwMOdRmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:11:11 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:11:11 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:11:11 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[921ef4ea-d111-4f1f-b0b4-b875656cf247]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:11:11 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[078e52a2-c5b0-4729-a119-d00f20c635af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5] added
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3621754d-f150-4813-aa73-48aeb03b1780]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e19e669-4c27-40c7-9b32-7e54086348ab]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwMOdRmq {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uwMOdRmq" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3583bf-ac8f-49d6-b07c-87bc56dc47d7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uwMOdRmq'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96157a81-3fce-4ff6-83b4-7ce56228cf65]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[486ed0d5-ceb2-411b-b31f-7a08f7d7aa67]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38f7e9d-7164-4c62-b577-c9e40e6ea1cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260]
Oct 30 14:11:11 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260] successful.
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfd19b3-368a-4c8a-80cd-136c40d5f5b7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e25b9e-cfa1-495b-8885-28d956cd5339]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:11:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc73e29-b477-4cd0-a008-6e4100cd802f]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:11:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwMOdRmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23032633534623933', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032633534623933', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG nova.objects.instance [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:11:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:11:12 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:11:12 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:11:12 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:11:12 user nova-compute[74319]:   <serial>7ab02383-38b5-4372-a319-576ac57ccbd5</serial>
Oct 30 14:11:12 user nova-compute[74319]: </disk>
Oct 30 14:11:12 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No VIF found with MAC fa:16:3e:39:76:be, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-19fc3556-16e3-445c-950a-1d648753a6f3 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.586s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 19.185s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:20 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:11:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:20 user nova-compute[74319]: INFO nova.compute.manager [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] instance snapshotting
Oct 30 14:11:20 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Beginning live snapshot process
Oct 30 14:11:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2.delta 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2.delta 1073741824" returned: 0 in 0.055s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 14:11:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:11:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:11:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 14:11:22 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:11:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2.delta /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2.delta /opt/stack/data/nova/instances/snapshots/tmp32ft3kwv/797841df526142fbbb10d9d9c97261c2" returned: 0 in 0.723s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Snapshot extracted, beginning image upload
Oct 30 14:11:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:26 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Snapshot image upload complete
Oct 30 14:11:26 user nova-compute[74319]: INFO nova.compute.manager [None req-6d671541-6f83-43c5-85d3-c0633879ef6c tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Took 5.96 seconds to snapshot the instance on the hypervisor.
Oct 30 14:11:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:11:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:26 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:11:26 user nova-compute[74319]: INFO nova.compute.claims [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Claim successful on node user
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:11:27 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.policy [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e8041d43400745a49af0cdd143a7fa96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '183376a76f7b4f6384593abf1714f239', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:11:27 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Creating image(s)
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "/opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "/opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.221s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk 1073741824" returned: 0 in 0.070s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Successfully created port: 471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Cannot resize image /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Ensure instance console log exists: /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Successfully updated port: 471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquired lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-changed-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Refreshing instance network info cache due to event network-changed-471b5916-5ef5-4400-8205-10993f68339e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] Acquiring lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updating instance_info_cache with network_info: [{"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Releasing lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Instance network_info: |[{"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] Acquired lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Refreshing network info cache for port 471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Start _get_guest_xml network_info=[{"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:11:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:11:30 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4799357',id=30,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+H4FdKjc5S/PepHwpG8KSNrxZUQqsOCLpq0jA75uVc3opf7iQKDl3/x2IRiAq98EmA4BVmZNsnVfGdG6V0LTjAEYgqXoQbpaex9oHhBznpY98AsHo5uyHrZ4iBolIByA==',key_name='tempest-keypair-632544931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183376a76f7b4f6384593abf1714f239',ramdisk_id='',reservation_id='r-k0wwknfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8041d43400745a49af0cdd143a7fa96',uuid=ebb16e81-4daa-447a-9d83-7a51c0e56745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converting VIF {"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lazy-loading 'pci_devices' on Instance uuid ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:11:30 user nova-compute[74319]:   <uuid>ebb16e81-4daa-447a-9d83-7a51c0e56745</uuid>
Oct 30 14:11:30 user nova-compute[74319]:   <name>instance-0000001e</name>
Oct 30 14:11:30 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:11:30 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:11:30 user nova-compute[74319]:   <metadata>
Oct 30 14:11:30 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:11:30 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577</nova:name>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:11:30</nova:creationTime>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:11:30 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:11:30 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:owner>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:user uuid="e8041d43400745a49af0cdd143a7fa96">tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member</nova:user>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:project uuid="183376a76f7b4f6384593abf1714f239">tempest-TestServerVolumeAttachScenarioOldVersion-1997443977</nova:project>
Oct 30 14:11:30 user nova-compute[74319]:       </nova:owner>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:11:30 user nova-compute[74319]:       <nova:ports>
Oct 30 14:11:30 user nova-compute[74319]:         <nova:port uuid="471b5916-5ef5-4400-8205-10993f68339e">
Oct 30 14:11:30 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 30 14:11:30 user nova-compute[74319]:         </nova:port>
Oct 30 14:11:30 user nova-compute[74319]:       </nova:ports>
Oct 30 14:11:30 user nova-compute[74319]:     </nova:instance>
Oct 30 14:11:30 user nova-compute[74319]:   </metadata>
Oct 30 14:11:30 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:11:30 user nova-compute[74319]:     <system>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="serial">ebb16e81-4daa-447a-9d83-7a51c0e56745</entry>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="uuid">ebb16e81-4daa-447a-9d83-7a51c0e56745</entry>
Oct 30 14:11:30 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:11:30 user nova-compute[74319]:     </system>
Oct 30 14:11:30 user nova-compute[74319]:   </sysinfo>
Oct 30 14:11:30 user nova-compute[74319]:   <os>
Oct 30 14:11:30 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:11:30 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:11:30 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:11:30 user nova-compute[74319]:   </os>
Oct 30 14:11:30 user nova-compute[74319]:   <features>
Oct 30 14:11:30 user nova-compute[74319]:     <acpi/>
Oct 30 14:11:30 user nova-compute[74319]:     <apic/>
Oct 30 14:11:30 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:11:30 user nova-compute[74319]:   </features>
Oct 30 14:11:30 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:11:30 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:11:30 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:11:30 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:11:30 user nova-compute[74319]:   </clock>
Oct 30 14:11:30 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:11:30 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:11:30 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:11:30 user nova-compute[74319]:   </cpu>
Oct 30 14:11:30 user nova-compute[74319]:   <devices>
Oct 30 14:11:30 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:11:30 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:11:30 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk"/>
Oct 30 14:11:30 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:11:30 user nova-compute[74319]:     </disk>
Oct 30 14:11:30 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:11:30 user nova-compute[74319]:       <mac address="fa:16:3e:aa:40:c0"/>
Oct 30 14:11:30 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:11:30 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:11:30 user nova-compute[74319]:       <target dev="tap471b5916-5e"/>
Oct 30 14:11:30 user nova-compute[74319]:     </interface>
Oct 30 14:11:30 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:11:30 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/console.log" append="off"/>
Oct 30 14:11:30 user nova-compute[74319]:     </serial>
Oct 30 14:11:30 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:11:30 user nova-compute[74319]:     <video>
Oct 30 14:11:30 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:11:30 user nova-compute[74319]:     </video>
Oct 30 14:11:30 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:11:30 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:11:30 user nova-compute[74319]:     </rng>
Oct 30 14:11:30 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:11:30 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:11:30 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:11:30 user nova-compute[74319]:     </memballoon>
Oct 30 14:11:30 user nova-compute[74319]:   </devices>
Oct 30 14:11:30 user nova-compute[74319]: </domain>
Oct 30 14:11:30 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4799357',id=30,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+H4FdKjc5S/PepHwpG8KSNrxZUQqsOCLpq0jA75uVc3opf7iQKDl3/x2IRiAq98EmA4BVmZNsnVfGdG6V0LTjAEYgqXoQbpaex9oHhBznpY98AsHo5uyHrZ4iBolIByA==',key_name='tempest-keypair-632544931',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='183376a76f7b4f6384593abf1714f239',ramdisk_id='',reservation_id='r-k0wwknfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8041d43400745a49af0cdd143a7fa96',uuid=ebb16e81-4daa-447a-9d83-7a51c0e56745,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converting VIF {"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG os_vif [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6edd6b13-6149-56e0-b45f-cb40ef7b1bbb', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap471b5916-5e, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap471b5916-5e, col_values=(('qos', UUID('0fc034e3-8bad-47b6-83b4-264233864c88')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap471b5916-5e, col_values=(('external_ids', {'iface-id': '471b5916-5ef5-4400-8205-10993f68339e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:40:c0', 'vm-uuid': 'ebb16e81-4daa-447a-9d83-7a51c0e56745'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:11:30 user nova-compute[74319]: INFO os_vif [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e')
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] No VIF found with MAC fa:16:3e:aa:40:c0, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updated VIF entry in instance network info cache for port 471b5916-5ef5-4400-8205-10993f68339e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updating instance_info_cache with network_info: [{"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-feb2a7d3-35cd-4b3b-90e0-c96b14ea4afe req-f07572f6-a57b-4aee-bae6-b548c8cac9b7 service nova] Releasing lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json" returned: 0 in 0.250s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] No waiting events found dispatching network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:32 user nova-compute[74319]: WARNING nova.compute.manager [req-953d414b-6ea4-4f0a-aedf-1ed4005a6371 req-94737034-675d-499e-accc-1fc454cf33ee service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received unexpected event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e for instance with vm_state building and task_state spawning.
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:11:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:11:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7851MB free_disk=25.075111389160156GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance acbcf291-490e-454c-bed2-197e923d657e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ebb16e81-4daa-447a-9d83-7a51c0e56745 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:11:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] No waiting events found dispatching network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:34 user nova-compute[74319]: WARNING nova.compute.manager [req-23d1e9e0-cb48-40fc-b834-c2d6520ba4d2 req-2e4e111c-ecce-4028-b884-742b226f96d1 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received unexpected event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e for instance with vm_state building and task_state spawning.
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:11:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Instance spawned successfully.
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:34 user nova-compute[74319]: INFO nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Took 6.49 seconds to spawn the instance on the hypervisor.
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:11:34 user nova-compute[74319]: INFO nova.compute.manager [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Took 7.71 seconds to build instance.
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8002d610-1499-4524-8fb9-1a8107320427 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.809s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:11:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:37 user nova-compute[74319]: INFO nova.compute.manager [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Unrescuing
Oct 30 14:11:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:11:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG nova.network.neutron [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'flavor' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:11:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:39 user nova-compute[74319]: WARNING nova.compute.manager [req-07e14170-baf2-4fb7-8002-8e7aa687945d req-c8891821-1f55-4311-a736-f17d3c398996 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:11:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance destroyed successfully.
Oct 30 14:11:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:41 user nova-compute[74319]: WARNING nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing instance network info cache due to event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updated VIF entry in instance network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing instance network info cache due to event network-changed-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Acquiring lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Acquired lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:11:41 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Refreshing network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:11:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updated VIF entry in instance network info cache for port 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:11:42 user nova-compute[74319]: DEBUG nova.network.neutron [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [{"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:11:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c227375f-9b56-4221-ba0e-6bce692c1008 req-8a8fa406-9abf-43db-b353-a0da84640802 service nova] Releasing lock "refresh_cache-8a3f3e7c-2080-42c0-adf0-44e7734782a4" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:43 user nova-compute[74319]: WARNING nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:11:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:11:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:11:43 user nova-compute[74319]: WARNING nova.compute.manager [req-1884cd8d-eab0-446c-9d3c-d7e8cbf6055d req-193f2469-8cfb-4ec8-90d7-686040184f51 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:11:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-1524db09-5d02-4a13-99f8-67bffdbe2152 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:11:45 user nova-compute[74319]: INFO nova.compute.manager [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Detaching volume 8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:11:45 user nova-compute[74319]: INFO nova.virt.block_device [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Attempting to driver detach volume 8e43d91d-336f-4c3b-8572-51860e6b6265 from mountpoint /dev/vdb
Oct 30 14:11:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Attempting to detach device vdb from instance 43fe7c9d-5a25-455b-8245-6028034d44a9 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:11:45 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:11:45 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:11:45 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:11:45 user nova-compute[74319]:   <serial>8e43d91d-336f-4c3b-8572-51860e6b6265</serial>
Oct 30 14:11:45 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:11:45 user nova-compute[74319]: </disk>
Oct 30 14:11:45 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:11:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully detached device vdb from instance 43fe7c9d-5a25-455b-8245-6028034d44a9 from the persistent domain config.
Oct 30 14:11:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43fe7c9d-5a25-455b-8245-6028034d44a9 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:11:45 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:11:45 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:11:45 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:11:45 user nova-compute[74319]:   <serial>8e43d91d-336f-4c3b-8572-51860e6b6265</serial>
Oct 30 14:11:45 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:11:45 user nova-compute[74319]: </disk>
Oct 30 14:11:45 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:11:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:11:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:05 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43fe7c9d-5a25-455b-8245-6028034d44a9 is timed out.
Oct 30 14:12:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully detached device vdb from instance 43fe7c9d-5a25-455b-8245-6028034d44a9 from the live domain config.
Oct 30 14:12:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zknTwLeJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:05 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3a902d-4fd0-402a-bec7-51734c5e3249]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:12:05 user nova-compute[74319]: No targets found.
Oct 30 14:12:05 user nova-compute[74319]: iSNS:
Oct 30 14:12:05 user nova-compute[74319]: No targets found.
Oct 30 14:12:05 user nova-compute[74319]: STATIC:
Oct 30 14:12:05 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:12:05 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:05 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:05 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5
Oct 30 14:12:05 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:05 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:05 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265
Oct 30 14:12:05 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:05 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:05 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:12:05 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:05 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:05 user nova-compute[74319]: FIRMWARE:
Oct 30 14:12:05 user nova-compute[74319]: No targets found.
Oct 30 14:12:05 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:12:05 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:12:05 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f7441e-661d-4bb1-ad74-8da03cfcf029]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7a0743-146f-4ca2-b342-43e55271e598]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:05 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 (non-flash)
Oct 30 14:12:05 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:05 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998445d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[429dd0d0-d2eb-4b28-aed6-e449d43a21db]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e2c4e1-cc27-4777-864e-ceff74f732c9]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f79ac-e972-400c-943a-711de20aee31]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0714a695-9bfa-48f2-94a5-96d54661ce99]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:12:05 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5670ae-61c8-4cd9-ad2a-938ed4e629f0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4a68b8-2b2c-4363-855d-67bb3a2adef5]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260]
Oct 30 14:12:06 user nova-compute[74319]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265, portal: 172.16.0.220,3260] successful.
Oct 30 14:12:06 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e43d91d-336f-4c3b-8572-51860e6b6265 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[134a328d-e139-4871-9c38-7ba809e1b73f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== disconnect_volume: return (310ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:12:06 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e6387aa-d999-41c9-91ac-b0ff649ac847 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:08 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance destroyed successfully.
Oct 30 14:12:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:08 user nova-compute[74319]: WARNING nova.compute.manager [req-5fd41a38-8903-4bad-822e-462990462c37 req-9d1bb10b-fbdf-423d-888e-892436248753 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state active and task_state powering-off.
Oct 30 14:12:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5b3c5acc-26b9-48b7-9877-b3aaa90b9cfe tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.867s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:10 user nova-compute[74319]: WARNING nova.compute.manager [req-2af3bc81-0632-453f-b311-efe203be7011 req-21beaa39-5775-4107-b0bb-0dff3d3e795f service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state stopped and task_state None.
Oct 30 14:12:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:11 user nova-compute[74319]: INFO nova.compute.manager [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Detaching volume 24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:12:11 user nova-compute[74319]: INFO nova.virt.block_device [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Attempting to driver detach volume 24bd7549-7d66-46a0-a7ac-51359c2d41cb from mountpoint /dev/vdb
Oct 30 14:12:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Attempting to detach device vdb from instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:12:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:12:11 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:12:11 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:12:11 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:12:11 user nova-compute[74319]:   <serial>24bd7549-7d66-46a0-a7ac-51359c2d41cb</serial>
Oct 30 14:12:11 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:12:11 user nova-compute[74319]: </disk>
Oct 30 14:12:11 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:12:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Successfully detached device vdb from instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 from the persistent domain config.
Oct 30 14:12:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:12:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:12:11 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:12:11 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:12:11 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:12:11 user nova-compute[74319]:   <serial>24bd7549-7d66-46a0-a7ac-51359c2d41cb</serial>
Oct 30 14:12:11 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:12:11 user nova-compute[74319]: </disk>
Oct 30 14:12:11 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:12:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:12:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:23 user nova-compute[74319]: INFO nova.compute.manager [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Detaching volume 7ab02383-38b5-4372-a319-576ac57ccbd5
Oct 30 14:12:23 user nova-compute[74319]: INFO nova.virt.block_device [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Attempting to driver detach volume 7ab02383-38b5-4372-a319-576ac57ccbd5 from mountpoint /dev/vdb
Oct 30 14:12:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Attempting to detach device vdb from instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:12:23 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:12:23 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:12:23 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:12:23 user nova-compute[74319]:   <serial>7ab02383-38b5-4372-a319-576ac57ccbd5</serial>
Oct 30 14:12:23 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:12:23 user nova-compute[74319]: </disk>
Oct 30 14:12:23 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:12:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully detached device vdb from instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef from the persistent domain config.
Oct 30 14:12:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:12:23 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:12:23 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:12:23 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:12:23 user nova-compute[74319]:   <serial>7ab02383-38b5-4372-a319-576ac57ccbd5</serial>
Oct 30 14:12:23 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:12:23 user nova-compute[74319]: </disk>
Oct 30 14:12:23 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:12:25 user nova-compute[74319]: INFO nova.compute.claims [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Claim successful on node user
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:12:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:12:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:12:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG nova.policy [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd03a462b75b14b4fb30f66a3b0e051d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ae8f2e2f199408596776c53c41a7986', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:12:26 user nova-compute[74319]: INFO nova.virt.block_device [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Booting with volume 1633576e-e50b-4953-b9b6-ab8c9d430b31 at /dev/vda
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.utils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a152213b-dbd3-458b-9cc9-929a16f4b124]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[035eaa14-5f4d-4c1a-b4c2-60432dab1931]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c0004-7e74-4d92-82a5-af5cc6ebd4ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d1a81d-2f7d-4443-afec-34ccb5d02846]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:12:26 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:12:26 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37681ce-1db9-4b6a-a4e8-3f88d9abc471]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG os_brick.utils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating existing volume attachment record: 89494366-cbac-4d75-809e-8cdd1f69de5e {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:12:26 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Successfully created port: bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Successfully updated port: bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-changed-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Refreshing instance network info cache due to event network-changed-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:12:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance network_info: |[{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Refreshing network info cache for port bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updated VIF entry in instance network info cache for port bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-835a7513-5dfc-4356-a1bd-ceb111f3f376 req-72af65d4-4017-487f-9303-970fa853a4b1 service nova] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:12:28 user nova-compute[74319]: INFO nova.compute.claims [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Claim successful on node user
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.313s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:12:29 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:12:29 user nova-compute[74319]: INFO nova.virt.block_device [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Booting with volume-backed-image 6e84464e-b827-48f1-88b9-f2140e869651 at /dev/vda
Oct 30 14:12:29 user nova-compute[74319]: DEBUG nova.policy [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a708010243464fe9bbf96c2e0e79a0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40f2668e6b874840ad286ca9a8189fd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Successfully created port: bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Successfully updated port: bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-changed-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Refreshing instance network info cache due to event network-changed-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] Acquiring lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating instance_info_cache with network_info: [{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance network_info: |[{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] Acquired lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Refreshing network info cache for port bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updated VIF entry in instance network info cache for port bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating instance_info_cache with network_info: [{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62afbaca-484d-4d92-b4be-5eea375d713e req-e5f74e84-c87f-4314-a26d-96249c3c4440 service nova] Releasing lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 is timed out.
Oct 30 14:12:32 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Successfully detached device vdb from instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 from the live domain config.
Oct 30 14:12:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XqgkJINF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:32 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8187a7a3-ae0e-4abf-a716-ecd27f94e820]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:12:32 user nova-compute[74319]: No targets found.
Oct 30 14:12:32 user nova-compute[74319]: iSNS:
Oct 30 14:12:32 user nova-compute[74319]: No targets found.
Oct 30 14:12:32 user nova-compute[74319]: STATIC:
Oct 30 14:12:32 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:12:32 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:32 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:32 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5
Oct 30 14:12:32 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:32 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:32 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb
Oct 30 14:12:32 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:32 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:32 user nova-compute[74319]: FIRMWARE:
Oct 30 14:12:32 user nova-compute[74319]: No targets found.
Oct 30 14:12:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:12:32 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:12:32 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd7d318-efa2-4b43-843c-c07a76846f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c3a887-482e-41e8-9f88-cd54af82c106]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:32 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:12:32 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:32 user nova-compute[74319]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb (non-flash)
Oct 30 14:12:32 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9746591b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522950d-7133-4d7b-8ee3-e341f361927a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[819be3d8-66ef-450b-acf1-94f062c4e284]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:12:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf8e67-b563-4591-b502-4f843aa6eab3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:12:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7823MB free_disk=25.03485870361328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[06683d82-e64f-4a5e-82b6-c45be606ee7e]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a5bb93-65ba-4538-a914-5dbf3eb35b83]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f80b57-39da-494e-bfa0-6cad7e8ff67a]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260]
Oct 30 14:12:33 user nova-compute[74319]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb, portal: 172.16.0.220,3260] successful.
Oct 30 14:12:33 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24bd7549-7d66-46a0-a7ac-51359c2d41cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98a1f2-278f-4413-a9af-5775f73228f3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.724s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] <== disconnect_volume: return (726ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance acbcf291-490e-454c-bed2-197e923d657e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ebb16e81-4daa-447a-9d83-7a51c0e56745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:12:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:34 user nova-compute[74319]: DEBUG nova.objects.instance [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'flavor' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-38882efe-8e5a-4698-a2b3-82851fa7d911 tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.353s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:12:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:12:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:12:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:12:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef is timed out.
Oct 30 14:12:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully detached device vdb from instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef from the live domain config.
Oct 30 14:12:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwMOdRmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e63c595-eca0-4893-aff5-eea6e67476fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:12:43 user nova-compute[74319]: No targets found.
Oct 30 14:12:43 user nova-compute[74319]: iSNS:
Oct 30 14:12:43 user nova-compute[74319]: No targets found.
Oct 30 14:12:43 user nova-compute[74319]: STATIC:
Oct 30 14:12:43 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:12:43 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:43 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:43 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5
Oct 30 14:12:43 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:43 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:43 user nova-compute[74319]: FIRMWARE:
Oct 30 14:12:43 user nova-compute[74319]: No targets found.
Oct 30 14:12:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:12:43 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:12:43 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb52a8-6ca9-4258-9f77-f0727e38a1c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a19d2a-09c1-4c7d-ac76-f88e53055d77]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:44 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:44 user nova-compute[74319]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 (non-flash)
Oct 30 14:12:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9985471c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4809385-bc5b-4c4e-87d4-01ec9bd389dd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[419b2360-b156-4a58-a335-9112d9f96539]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17f355b-a6bb-479d-8f4b-c43a24984a48]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1244c819-50c4-4e00-85b5-c2f48b53a63c]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[137a5282-7ec5-4c2c-89df-3ecfffa1c27b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d6e432-ac95-45b3-8906-5ec2484bfa8c]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260]
Oct 30 14:12:44 user nova-compute[74319]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5, portal: 172.16.0.220,3260] successful.
Oct 30 14:12:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd4f9f-1983-43c9-87e8-88a5e6f6fcfd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== disconnect_volume: return (300ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c979cfa6-994d-4e67-bf81-3cecc9fb946a tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.674s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:45 user nova-compute[74319]: INFO nova.compute.manager [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Terminating instance
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-unplugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] No waiting events found dispatching network-vif-unplugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-2108bac9-3e70-488e-9141-e89523d0ea81 req-14b9f7ff-173a-416a-bdda-e721b71fd208 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-unplugged-1935da15-1812-430c-b6d7-618a069e2915 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:12:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Instance destroyed successfully.
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'resources' on Instance uuid 83ed38ff-887e-45b1-ae1e-ba0e004a30ef {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:08:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-159810967',display_name='tempest-VolumesSnapshotTestJSON-instance-159810967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-159810967',id=27,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF81GjISoDrlIgoUhfcY9MzAexv7kixyNEkjE/ySNAaGDjCiNXW2+lMp2wYJnTEGY8w17L4dZpjUTT1ICWxGKvJ8sUntScZsJmGSuMSngcrKBzWlcOCdyljuF3A5hqjRQ==',key_name='tempest-keypair-1272234590',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-8sbmzetk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:09:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=83ed38ff-887e-45b1-ae1e-ba0e004a30ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "1935da15-1812-430c-b6d7-618a069e2915", "address": "fa:16:3e:39:76:be", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1935da15-18", "ovs_interfaceid": "1935da15-1812-430c-b6d7-618a069e2915", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:12:45 user nova-compute[74319]: DEBUG os_vif [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1935da15-18, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9fa52aa-9cc6-49ad-84b2-a3334af9ae88) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:46 user nova-compute[74319]: INFO os_vif [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:76:be,bridge_name='br-int',has_traffic_filtering=True,id=1935da15-1812-430c-b6d7-618a069e2915,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1935da15-18')
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uwMOdRmq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:46 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06076ee-35d2-436d-9271-8ab2084dc23a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:12:46 user nova-compute[74319]: No targets found.
Oct 30 14:12:46 user nova-compute[74319]: iSNS:
Oct 30 14:12:46 user nova-compute[74319]: No targets found.
Oct 30 14:12:46 user nova-compute[74319]: STATIC:
Oct 30 14:12:46 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:12:46 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:12:46 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:12:46 user nova-compute[74319]: FIRMWARE:
Oct 30 14:12:46 user nova-compute[74319]: No targets found.
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:12:46 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:12:46 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ab02383-38b5-4372-a319-576ac57ccbd5', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e33f8fd-841d-49d5-b5bc-77ed3400c4bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[684a5b07-0144-48e4-ae1d-6a3e292d735d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a1515900>, {}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Disconnecting from: [] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.068s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== disconnect_volume: return (69ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:12:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Deleting instance files /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef_del
Oct 30 14:12:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Deletion of /opt/stack/data/nova/instances/83ed38ff-887e-45b1-ae1e-ba0e004a30ef_del complete
Oct 30 14:12:46 user nova-compute[74319]: INFO nova.compute.manager [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:12:46 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Creating image(s)
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Ensure instance console log exists: /opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start _get_guest_xml network_info=[{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '89494366-cbac-4d75-809e-8cdd1f69de5e', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '78691de8-10df-403c-91d2-afc7594a413d', 'attached_at': '', 'detached_at': '', 'volume_id': '1633576e-e50b-4953-b9b6-ab8c9d430b31', 'serial': '1633576e-e50b-4953-b9b6-ab8c9d430b31'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:12:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:12:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:46 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:46 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:12:46 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd93e8-6e25-40da-b12c-b3a421ad9230]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:12:46 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f30f842-42dd-4d7c-aafb-c27bf48c3b6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31] added
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fa52f3-8fb8-439e-965c-32f0000be008]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a1f2b-4214-40fb-832d-9ccafe35d036]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAMyJLIx {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAMyJLIx" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7851acc-95fd-47ec-bb76-1167795f83c2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAMyJLIx'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0a78d-58fc-400a-8424-b89a62b632c4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70bd0df-957c-49a5-9dc9-5ca5a185a292]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea7232-e888-4621-b1e0-cdd27133fc60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]
Oct 30 14:12:46 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0ded90-12ac-4bb7-b42c-2187bb26bb5e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e469d6ab-ecca-4733-8fca-cbbd44dcc977]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:12:46 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:12:46 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[945286e5-6aff-4a8f-937a-550701387994]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:12:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:47 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Took 0.89 seconds to deallocate network for instance.
Oct 30 14:12:47 user nova-compute[74319]: WARNING nova.volume.cinder [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Attachment 81e3c6fb-0410-43a4-95d7-e598f6364b98 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 81e3c6fb-0410-43a4-95d7-e598f6364b98. (HTTP 404) (Request-ID: req-8344bf39-61ff-4abc-b27a-cd4fdc2bd9d3)
Oct 30 14:12:47 user nova-compute[74319]: INFO nova.compute.manager [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Took 0.02 seconds to detach 1 volumes for instance.
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] Acquiring lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] No waiting events found dispatching network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:47 user nova-compute[74319]: WARNING nova.compute.manager [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received unexpected event network-vif-plugged-1935da15-1812-430c-b6d7-618a069e2915 for instance with vm_state deleted and task_state None.
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-7ebbbd64-abb6-49f2-af58-78312dbd19da req-a9cd6085-5c8c-4367-9f48-36a06b7f4ab1 service nova] [instance: 83ed38ff-887e-45b1-ae1e-ba0e004a30ef] Received event network-vif-deleted-1935da15-1812-430c-b6d7-618a069e2915 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:47 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Deleted allocations for instance 83ed38ff-887e-45b1-ae1e-ba0e004a30ef
Oct 30 14:12:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23038666166393033', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038666166393033', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'pci_devices' on Instance uuid 78691de8-10df-403c-91d2-afc7594a413d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:12:47 user nova-compute[74319]:   <uuid>78691de8-10df-403c-91d2-afc7594a413d</uuid>
Oct 30 14:12:47 user nova-compute[74319]:   <name>instance-0000001f</name>
Oct 30 14:12:47 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:12:47 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:12:47 user nova-compute[74319]:   <metadata>
Oct 30 14:12:47 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:12:47 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:12:47 user nova-compute[74319]:       <nova:name>tempest-ServerActionsTestOtherA-server-16653019</nova:name>
Oct 30 14:12:47 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:12:46</nova:creationTime>
Oct 30 14:12:47 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:12:47 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:12:47 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:12:47 user nova-compute[74319]:       <nova:owner>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:user uuid="d03a462b75b14b4fb30f66a3b0e051d4">tempest-ServerActionsTestOtherA-768990641-project-member</nova:user>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:project uuid="0ae8f2e2f199408596776c53c41a7986">tempest-ServerActionsTestOtherA-768990641</nova:project>
Oct 30 14:12:47 user nova-compute[74319]:       </nova:owner>
Oct 30 14:12:47 user nova-compute[74319]:       <nova:ports>
Oct 30 14:12:47 user nova-compute[74319]:         <nova:port uuid="bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f">
Oct 30 14:12:47 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:12:47 user nova-compute[74319]:         </nova:port>
Oct 30 14:12:47 user nova-compute[74319]:       </nova:ports>
Oct 30 14:12:47 user nova-compute[74319]:     </nova:instance>
Oct 30 14:12:47 user nova-compute[74319]:   </metadata>
Oct 30 14:12:47 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:12:47 user nova-compute[74319]:     <system>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="serial">78691de8-10df-403c-91d2-afc7594a413d</entry>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="uuid">78691de8-10df-403c-91d2-afc7594a413d</entry>
Oct 30 14:12:47 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:12:47 user nova-compute[74319]:     </system>
Oct 30 14:12:47 user nova-compute[74319]:   </sysinfo>
Oct 30 14:12:47 user nova-compute[74319]:   <os>
Oct 30 14:12:47 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:12:47 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:12:47 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:12:47 user nova-compute[74319]:   </os>
Oct 30 14:12:47 user nova-compute[74319]:   <features>
Oct 30 14:12:47 user nova-compute[74319]:     <acpi/>
Oct 30 14:12:47 user nova-compute[74319]:     <apic/>
Oct 30 14:12:47 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:12:47 user nova-compute[74319]:   </features>
Oct 30 14:12:47 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:12:47 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:12:47 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:12:47 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:12:47 user nova-compute[74319]:   </clock>
Oct 30 14:12:47 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:12:47 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:12:47 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:12:47 user nova-compute[74319]:   </cpu>
Oct 30 14:12:47 user nova-compute[74319]:   <devices>
Oct 30 14:12:47 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:12:47 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:12:47 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:12:47 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:12:47 user nova-compute[74319]:       <serial>1633576e-e50b-4953-b9b6-ab8c9d430b31</serial>
Oct 30 14:12:47 user nova-compute[74319]:     </disk>
Oct 30 14:12:47 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:12:47 user nova-compute[74319]:       <mac address="fa:16:3e:a6:cd:72"/>
Oct 30 14:12:47 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:12:47 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:12:47 user nova-compute[74319]:       <target dev="tapbfa6539d-c8"/>
Oct 30 14:12:47 user nova-compute[74319]:     </interface>
Oct 30 14:12:47 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:12:47 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d/console.log" append="off"/>
Oct 30 14:12:47 user nova-compute[74319]:     </serial>
Oct 30 14:12:47 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:12:47 user nova-compute[74319]:     <video>
Oct 30 14:12:47 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:12:47 user nova-compute[74319]:     </video>
Oct 30 14:12:47 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:12:47 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:12:47 user nova-compute[74319]:     </rng>
Oct 30 14:12:47 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:12:47 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:12:47 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:12:47 user nova-compute[74319]:     </memballoon>
Oct 30 14:12:47 user nova-compute[74319]:   </devices>
Oct 30 14:12:47 user nova-compute[74319]: </domain>
Oct 30 14:12:47 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG os_vif [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '372a00b4-9a11-5a70-b423-7feced7390cc', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8ab4ab8f-fd99-418e-8bab-e51e4a639c43 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "83ed38ff-887e-45b1-ae1e-ba0e004a30ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.510s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfa6539d-c8, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfa6539d-c8, col_values=(('qos', UUID('eb21eda4-a5b3-4829-9dcf-02eb288982f5')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfa6539d-c8, col_values=(('external_ids', {'iface-id': 'bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:cd:72', 'vm-uuid': '78691de8-10df-403c-91d2-afc7594a413d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:47 user nova-compute[74319]: INFO os_vif [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8')
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:a6:cd:72, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing instance network info cache due to event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:12:47 user nova-compute[74319]: DEBUG nova.network.neutron [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:12:48 user nova-compute[74319]: DEBUG nova.network.neutron [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updated VIF entry in instance network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:12:48 user nova-compute[74319]: DEBUG nova.network.neutron [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:12:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9e90e0f5-c7ea-437e-9782-b18e61df9acb req-bca1dc98-7ba4-49b7-9fe7-a0c5ab3e1caa service nova] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:50 user nova-compute[74319]: WARNING nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state building and task_state spawning.
Oct 30 14:12:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:50 user nova-compute[74319]: WARNING nova.compute.manager [req-211c2aba-2141-4441-898f-4f4b81f1a085 req-c467845a-70f3-4622-8c0c-6064705c861a service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state building and task_state spawning.
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.utils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26f604d-670c-46f4-9359-0025fe8fe07d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[884229d1-1666-41dc-a568-4d3c0991c173]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f3cf8f-e226-4c67-bb44-cc135807f876]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b2618-1e5e-43b1-bba5-6706cdcd022d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:12:50 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:12:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acb5dfb-8684-4b72-a45b-29436a6071d0]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG os_brick.utils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:12:50 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating existing volume attachment record: 7c1f42fe-001d-44f5-a992-2e90b82ac7f3 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:12:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance spawned successfully.
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:12:51 user nova-compute[74319]: INFO nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 30 14:12:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:12:51 user nova-compute[74319]: INFO nova.compute.manager [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Took 26.35 seconds to build instance.
Oct 30 14:12:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb0a15ca-38e6-4427-ba8d-945313bac3a6 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.448s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:55 user nova-compute[74319]: INFO nova.compute.manager [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Shelving
Oct 30 14:12:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance destroyed successfully.
Oct 30 14:12:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Beginning cold snapshot process
Oct 30 14:12:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:56 user nova-compute[74319]: WARNING nova.compute.manager [req-b9a4ab33-6b19-42cc-bfe0-7ecf95c9e6a9 req-e5e27ff4-d9d7-4625-a5fd-76f1c968deea service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state active and task_state shelving.
Oct 30 14:12:56 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:12:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk /opt/stack/data/nova/instances/snapshots/tmp7mviqwib/6c8da13dd9794ee996d5c885af9ba745 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:12:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk /opt/stack/data/nova/instances/snapshots/tmp7mviqwib/6c8da13dd9794ee996d5c885af9ba745" returned: 0 in 0.700s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:12:57 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Snapshot extracted, beginning image upload
Oct 30 14:12:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:12:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:12:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:12:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:12:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:12:58 user nova-compute[74319]: DEBUG nova.compute.manager [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:12:58 user nova-compute[74319]: WARNING nova.compute.manager [req-07c6fd07-cad3-48db-b090-6d2206626b58 req-c7b62bed-a6d1-4538-826b-14279a80e6d2 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state active and task_state shelving_image_uploading.
Oct 30 14:12:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Snapshot image upload complete
Oct 30 14:13:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:13:00 user nova-compute[74319]: INFO nova.compute.manager [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Shelve offloading
Oct 30 14:13:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance destroyed successfully.
Oct 30 14:13:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:13:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:13:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance destroyed successfully.
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'resources' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatiEjrg54c7ufpvCpKiN4N+7JgFt2H+65DC18ymT5sW2GL1SfP5+qZUO5niQ5l71gzOgdx5XEgvrJjBTO1u8NErc9qmP6xFqISZrllcnQB0umqah4auZaBqbCGR8wxtQ==',key_name='tempest-keypair-1424537780',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:13:00.083928',shelved_host='user',shelved_image_id='6fb00cb7-5856-43ab-adf2-55f67bf11077'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:12:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG os_vif [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7007b011-9b, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing instance network info cache due to event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG nova.network.neutron [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=516a2da1-560d-4864-aaa6-7b589fd4d327) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:01 user nova-compute[74319]: INFO os_vif [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b')
Oct 30 14:13:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Deleting instance files /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e_del
Oct 30 14:13:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Deletion of /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e_del complete
Oct 30 14:13:01 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Deleted allocations for instance acbcf291-490e-454c-bed2-197e923d657e
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.objects.instance [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'numa_topology' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.objects.base [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<acbcf291-490e-454c-bed2-197e923d657e> lazy-loaded attributes: resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.network.neutron [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updated VIF entry in instance network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.network.neutron [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7007b011-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4e4b10a0-1561-4107-95ee-887a3edddb79 req-b8bb45bb-53ae-4510-bf12-2f21ddb46343 service nova] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:02 user nova-compute[74319]: INFO nova.compute.manager [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Terminating instance
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-420ea731-73af-4c3f-9591-13feac74be13 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.997s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-80ce9154-5e61-4386-89ab-a491a6cfadfb req-b290cb41-f9eb-4fdf-a4e6-d39dbb4804fa service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-unplugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:13:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Instance destroyed successfully.
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lazy-loading 'resources' on Instance uuid 8a3f3e7c-2080-42c0-adf0-44e7734782a4 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1586366234',display_name='tempest-ServerStableDeviceRescueTest-server-1586366234',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1586366234',id=23,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF507esoFzABrF72jsRukC2boVMp8hRTOhy8lzHqOUHI5qTLXU6bWt+8rqLzhikXkJtMS+VqXwM+/a7Wt8R0Oj0oj4Kbc/K6uYSVfAVJb0Zfvk/KAVZkLwNTYhYHvezfdg==',key_name='tempest-keypair-2014099519',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:09:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d27a717598b4f839ad4a9c12073b240',ramdisk_id='',reservation_id='r-0mg360fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-428345104',owner_user_name='tempest-ServerStableDeviceRescueTest-428345104-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:11:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4881f45201f94726bcf3cf5065c8afae',uuid=8a3f3e7c-2080-42c0-adf0-44e7734782a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converting VIF {"id": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "address": "fa:16:3e:de:a1:bd", "network": {"id": "9b011d3a-e67d-4071-9f3c-367959462bf5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2102010530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d27a717598b4f839ad4a9c12073b240", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6130e6dd-5c", "ovs_interfaceid": "6130e6dd-5c0f-4e59-a446-eba9c5ab6ade", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG os_vif [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6130e6dd-5c, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=599218d0-f9d0-4742-96bc-1951af847817) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:03 user nova-compute[74319]: INFO os_vif [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:a1:bd,bridge_name='br-int',has_traffic_filtering=True,id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade,network=Network(9b011d3a-e67d-4071-9f3c-367959462bf5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6130e6dd-5c')
Oct 30 14:13:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Deleting instance files /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4_del
Oct 30 14:13:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Deletion of /opt/stack/data/nova/instances/8a3f3e7c-2080-42c0-adf0-44e7734782a4_del complete
Oct 30 14:13:03 user nova-compute[74319]: INFO nova.compute.manager [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 14:13:03 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:13:03 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:04 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Took 0.72 seconds to deallocate network for instance.
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-e25a410a-fdb8-406b-8aac-ad8bab4d163c req-5bb38f6b-9eff-4549-b4f8-3b16d35a9585 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-deleted-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:04 user nova-compute[74319]: INFO nova.compute.manager [req-e25a410a-fdb8-406b-8aac-ad8bab4d163c req-5bb38f6b-9eff-4549-b4f8-3b16d35a9585 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Neutron deleted interface 6130e6dd-5c0f-4e59-a446-eba9c5ab6ade; detaching it from the instance and deleting it from the info cache
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-e25a410a-fdb8-406b-8aac-ad8bab4d163c req-5bb38f6b-9eff-4549-b4f8-3b16d35a9585 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-e25a410a-fdb8-406b-8aac-ad8bab4d163c req-5bb38f6b-9eff-4549-b4f8-3b16d35a9585 service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Detach interface failed, port_id=6130e6dd-5c0f-4e59-a446-eba9c5ab6ade, reason: Instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:04 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Deleted allocations for instance 8a3f3e7c-2080-42c0-adf0-44e7734782a4
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fb8295c8-330d-4672-b751-d71a7415275c tempest-ServerStableDeviceRescueTest-428345104 tempest-ServerStableDeviceRescueTest-428345104-project-member] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.199s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] Acquiring lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] Lock "8a3f3e7c-2080-42c0-adf0-44e7734782a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] No waiting events found dispatching network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:04 user nova-compute[74319]: WARNING nova.compute.manager [req-819ea1a0-f35f-4435-b50b-e5e3f60554ff req-e3d64bd1-4f33-49b2-b668-06b1fcacd58b service nova] [instance: 8a3f3e7c-2080-42c0-adf0-44e7734782a4] Received unexpected event network-vif-plugged-6130e6dd-5c0f-4e59-a446-eba9c5ab6ade for instance with vm_state deleted and task_state None.
Oct 30 14:13:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-changed-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Refreshing instance network info cache due to event network-changed-471b5916-5ef5-4400-8205-10993f68339e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:13:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] Acquiring lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] Acquired lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Refreshing network info cache for port 471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:13:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updated VIF entry in instance network info cache for port 471b5916-5ef5-4400-8205-10993f68339e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:13:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updating instance_info_cache with network_info: [{"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-316fd535-6eaf-41c9-9e53-e24590bbb54e req-3001b063-eb13-40e1-a8d3-1f7945285010 service nova] Releasing lock "refresh_cache-ebb16e81-4daa-447a-9d83-7a51c0e56745" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lazy-loading 'flavor' on Instance uuid ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:24 user nova-compute[74319]: INFO nova.compute.manager [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Attaching volume 67a37d98-8165-4671-9d11-45ea25d4b005 to /dev/vdb
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.utils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebae26e-fc4b-446b-807e-ededd303fb1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2828e2b3-456d-41e0-b962-623027495336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a824909-1157-437f-ab2c-369ff4ae6a5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6e3522-f87b-4b6c-b96b-08f0d05a114f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:13:24 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:13:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8a877-8671-47c4-b441-52b22eae4816]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG os_brick.utils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:13:24 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updating existing volume attachment record: 03db5344-7668-4e14-bd17-e14368045c3b {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:13:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:13:28 user nova-compute[74319]: INFO nova.compute.claims [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Claim successful on node user
Oct 30 14:13:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:13:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.policy [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1384ea11d244bb3b5bbd47634caef19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46c403cd3f6549a3b44268ae4f36fa9b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:13:28 user nova-compute[74319]: INFO nova.virt.block_device [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Booting with volume 70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 at /dev/vda
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.utils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b87c91a-6d84-4e97-ae57-50bd26c09872]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7694a2-abd0-4fad-bb1a-5b971de25064]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[114818ec-498a-4fef-9adb-4674ecab8091]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fe1181-ef51-43ea-ac6e-98cac4a54f6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:13:28 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e8adbe-a498-49e3-a960-7ef307647b06]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG os_brick.utils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating existing volume attachment record: 5ff402a0-1e46-4ce7-8db4-d3265426ab17 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:28 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Successfully created port: 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Successfully updated port: 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing instance network info cache due to event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance network_info: |[{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:13:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8114MB free_disk=25.154071807861328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ebb16e81-4daa-447a-9d83-7a51c0e56745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5048109c-d671-4953-b819-fdb69e3052fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updated VIF entry in instance network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5ea5e33e-1b57-45ff-9ade-35dc1e0e2e4a req-defca567-f921-424f-acae-6b1e6e35665c service nova] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:32 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:13:32 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:13:32 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:13:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:13:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Skipping network cache update for instance because it is Building. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 14:13:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Skipping network cache update for instance because it is Building. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:13:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:13:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Creating image(s)
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Ensure instance console log exists: /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start _get_guest_xml network_info=[{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '7c1f42fe-001d-44f5-a992-2e90b82ac7f3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5820195e-e4d1-44a4-86d8-25f003fca44a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'serial': 'ace075d9-7d66-4eda-a20b-def23d6c2ec0'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:13:42 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:42 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:13:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:42 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[297ed24c-7110-4827-ac06-bb933ced2ddc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:13:42 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5d8fa8-c20f-43c0-8264-efb8a9aa1937]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0] added
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4d7f28-7eec-4b43-a24d-2d4ce6421a54]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[743deb95-0139-4902-8fb9-ed285677d122]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idBqLVkx {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idBqLVkx" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a7cbb-fa3b-470d-96f1-c08287b56dfe]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idBqLVkx'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f209eb-2c9f-4d81-80f8-b6145cbbbddb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca4e9ac-e4f4-46c1-bc1c-dc5051f9408d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[872fbcc6-5368-410a-8f87-de119e020ec1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260]
Oct 30 14:13:42 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260] successful.
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adad06b2-dd0d-4d20-9833-17fce324d2ea]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12d5abf-27e1-4941-959b-16356493f9f3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:42 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e61faf-5140-4508-8669-6b06ba892f08]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:42 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23663636265323337', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663636265323337', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1463439560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1463439560',id=32,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ksogu7dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:12:29Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=5820195e-e4d1-44a4-86d8-25f003fca44a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:13:44 user nova-compute[74319]:   <uuid>5820195e-e4d1-44a4-86d8-25f003fca44a</uuid>
Oct 30 14:13:44 user nova-compute[74319]:   <name>instance-00000020</name>
Oct 30 14:13:44 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:13:44 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:13:44 user nova-compute[74319]:   <metadata>
Oct 30 14:13:44 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:13:44 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1463439560</nova:name>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:13:42</nova:creationTime>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:13:44 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:13:44 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:owner>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:13:44 user nova-compute[74319]:       </nova:owner>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:13:44 user nova-compute[74319]:       <nova:ports>
Oct 30 14:13:44 user nova-compute[74319]:         <nova:port uuid="bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8">
Oct 30 14:13:44 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 14:13:44 user nova-compute[74319]:         </nova:port>
Oct 30 14:13:44 user nova-compute[74319]:       </nova:ports>
Oct 30 14:13:44 user nova-compute[74319]:     </nova:instance>
Oct 30 14:13:44 user nova-compute[74319]:   </metadata>
Oct 30 14:13:44 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:13:44 user nova-compute[74319]:     <system>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="serial">5820195e-e4d1-44a4-86d8-25f003fca44a</entry>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="uuid">5820195e-e4d1-44a4-86d8-25f003fca44a</entry>
Oct 30 14:13:44 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:13:44 user nova-compute[74319]:     </system>
Oct 30 14:13:44 user nova-compute[74319]:   </sysinfo>
Oct 30 14:13:44 user nova-compute[74319]:   <os>
Oct 30 14:13:44 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:13:44 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:13:44 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:13:44 user nova-compute[74319]:   </os>
Oct 30 14:13:44 user nova-compute[74319]:   <features>
Oct 30 14:13:44 user nova-compute[74319]:     <acpi/>
Oct 30 14:13:44 user nova-compute[74319]:     <apic/>
Oct 30 14:13:44 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:13:44 user nova-compute[74319]:   </features>
Oct 30 14:13:44 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:13:44 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:13:44 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:13:44 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:13:44 user nova-compute[74319]:   </clock>
Oct 30 14:13:44 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:13:44 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:13:44 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:13:44 user nova-compute[74319]:   </cpu>
Oct 30 14:13:44 user nova-compute[74319]:   <devices>
Oct 30 14:13:44 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:13:44 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:13:44 user nova-compute[74319]:       <source dev="/dev/sdd"/>
Oct 30 14:13:44 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:13:44 user nova-compute[74319]:       <serial>ace075d9-7d66-4eda-a20b-def23d6c2ec0</serial>
Oct 30 14:13:44 user nova-compute[74319]:     </disk>
Oct 30 14:13:44 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:13:44 user nova-compute[74319]:       <mac address="fa:16:3e:2c:39:7f"/>
Oct 30 14:13:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:44 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:13:44 user nova-compute[74319]:       <target dev="tapbad6e3d1-e7"/>
Oct 30 14:13:44 user nova-compute[74319]:     </interface>
Oct 30 14:13:44 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:13:44 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/console.log" append="off"/>
Oct 30 14:13:44 user nova-compute[74319]:     </serial>
Oct 30 14:13:44 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:13:44 user nova-compute[74319]:     <video>
Oct 30 14:13:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:44 user nova-compute[74319]:     </video>
Oct 30 14:13:44 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:13:44 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:13:44 user nova-compute[74319]:     </rng>
Oct 30 14:13:44 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:13:44 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:13:44 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:13:44 user nova-compute[74319]:     </memballoon>
Oct 30 14:13:44 user nova-compute[74319]:   </devices>
Oct 30 14:13:44 user nova-compute[74319]: </domain>
Oct 30 14:13:44 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1463439560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1463439560',id=32,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ksogu7dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:12:29Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=5820195e-e4d1-44a4-86d8-25f003fca44a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG os_vif [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c9c06da1-12f6-5170-add2-83b55fa3b96a', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad6e3d1-e7, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbad6e3d1-e7, col_values=(('qos', UUID('cb7a6566-ae05-43f0-a06e-453910e4a86d')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbad6e3d1-e7, col_values=(('external_ids', {'iface-id': 'bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:39:7f', 'vm-uuid': '5820195e-e4d1-44a4-86d8-25f003fca44a'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:44 user nova-compute[74319]: INFO os_vif [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7')
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:13:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:2c:39:7f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADgEvbGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:13:45 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:45 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:45 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f4fca-79ad-4837-91b5-5bcfa22d1cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:13:45 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb8b430-ddb9-48ac-a2b9-78ce2c81f404]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005] added
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95cfeb6-59c7-49f7-8071-f8a2d28a9e37]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbc2aa1-9bdc-4d90-8607-1dc843c08fb3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADgEvbGH {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ADgEvbGH" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e51bbc-ea23-43d6-9304-9a12092fb087]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ADgEvbGH'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5066eed-55ad-4ae5-89dc-321a85ffa808]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7783df-4605-4a73-88a7-14e0c428f157]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:45 user nova-compute[74319]: WARNING nova.compute.manager [req-3229ae63-6557-4d0e-9a60-6dca9ecfdcc0 req-ec60aab2-c4e4-4413-84b3-e4e952b4c441 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state building and task_state spawning.
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d853bc4a-ab51-4921-8e6d-27c3e135648e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260]
Oct 30 14:13:45 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260] successful.
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6684df-55bb-4cb3-9135-a662d553cefb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ca7172-08f3-4c39-8ee3-f805244cfb8b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[758f2ab3-0634-4d1d-b4c8-6ffadb15dc5f]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:13:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADgEvbGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:13:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:46 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26565386131653132', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:13:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565386131653132', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:13:46 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lazy-loading 'flavor' on Instance uuid ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:13:46 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:13:46 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:13:46 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:13:46 user nova-compute[74319]:   <serial>67a37d98-8165-4671-9d11-45ea25d4b005</serial>
Oct 30 14:13:46 user nova-compute[74319]: </disk>
Oct 30 14:13:46 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] No VIF found with MAC fa:16:3e:aa:40:c0, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1a319935-1842-4f58-a764-6b1fa45da1f2 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.757s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:13:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance spawned successfully.
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:47 user nova-compute[74319]: INFO nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Took 5.19 seconds to spawn the instance on the hypervisor.
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:47 user nova-compute[74319]: WARNING nova.compute.manager [req-710ee4be-5e48-4191-adf7-2c931d51eaa4 req-6b7d0aeb-3ca8-4457-bed6-94a3466c86bc service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state building and task_state spawning.
Oct 30 14:13:47 user nova-compute[74319]: INFO nova.compute.manager [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Took 79.01 seconds to build instance.
Oct 30 14:13:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6edc39db-ffd8-4279-8dcf-4f6bab148d55 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 79.127s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:48 user nova-compute[74319]: INFO nova.compute.manager [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Detaching volume 67a37d98-8165-4671-9d11-45ea25d4b005
Oct 30 14:13:48 user nova-compute[74319]: INFO nova.virt.block_device [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Attempting to driver detach volume 67a37d98-8165-4671-9d11-45ea25d4b005 from mountpoint /dev/vdb
Oct 30 14:13:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Attempting to detach device vdb from instance ebb16e81-4daa-447a-9d83-7a51c0e56745 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:13:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:13:48 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:13:48 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:13:48 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:13:48 user nova-compute[74319]:   <serial>67a37d98-8165-4671-9d11-45ea25d4b005</serial>
Oct 30 14:13:48 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:13:48 user nova-compute[74319]: </disk>
Oct 30 14:13:48 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:13:48 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Successfully detached device vdb from instance ebb16e81-4daa-447a-9d83-7a51c0e56745 from the persistent domain config.
Oct 30 14:13:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ebb16e81-4daa-447a-9d83-7a51c0e56745 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:13:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:13:48 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:13:48 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:13:48 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:13:48 user nova-compute[74319]:   <serial>67a37d98-8165-4671-9d11-45ea25d4b005</serial>
Oct 30 14:13:48 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:13:48 user nova-compute[74319]: </disk>
Oct 30 14:13:48 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:13:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:13:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Creating image(s)
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Ensure instance console log exists: /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start _get_guest_xml network_info=[{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '5ff402a0-1e46-4ce7-8db4-d3265426ab17', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5048109c-d671-4953-b819-fdb69e3052fa', 'attached_at': '', 'detached_at': '', 'volume_id': '70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'serial': '70ec54b9-c9c6-4fd6-8ef0-ac08dedde572'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:13:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:50 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:13:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:50 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:13:50 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[050f037e-f3fd-4506-b880-05b8498be1ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:13:50 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52f5348-bfe5-416a-a52c-8c6e343234f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572] added
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dbc28a-5538-4eab-a5fe-77b7ada01589]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8931a6-c8a3-4c81-8472-c207acb703eb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbUCryHu {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbUCryHu" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d5872-9d1a-429f-b18c-e9202dbe36d8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbUCryHu'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec022e21-277e-4152-9d5c-5cf1259f4ddb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1216703-1e9b-4ed9-971b-0244a5b57f5c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958dc6c-62f1-4ac6-a61c-74bdb2d0be76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]
Oct 30 14:13:50 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcbf577-458c-4840-bf4d-bac488f33917]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[15293d87-6f46-41a4-a4de-a071d3414112]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:13:50 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[506b4bd4-09fb-4eba-8605-6b75f30d22e5]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:13:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23262613931333437', 'path': '/dev/sdf'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262613931333437', 'path': '/dev/sdf'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdP9qy65aGRzPvBVvvYInx9XgQMNetAWvJWaPPJbeVYG7pja9CsUPMH2bOIPmjS+VJNiMC4Z6ynLByOxDS9HLrMlyaZQNIEJTdw2nNIr2Oq2vqN1M9cy77Ox4vwv+Ivqw==',key_name='tempest-TestShelveInstance-77344443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:13:29Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'pci_devices' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:13:51 user nova-compute[74319]:   <uuid>5048109c-d671-4953-b819-fdb69e3052fa</uuid>
Oct 30 14:13:51 user nova-compute[74319]:   <name>instance-00000021</name>
Oct 30 14:13:51 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:13:51 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:13:51 user nova-compute[74319]:   <metadata>
Oct 30 14:13:51 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:13:51 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:13:51 user nova-compute[74319]:       <nova:name>tempest-TestShelveInstance-server-1149684489</nova:name>
Oct 30 14:13:51 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:13:50</nova:creationTime>
Oct 30 14:13:51 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:13:51 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:13:51 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:13:51 user nova-compute[74319]:       <nova:owner>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:user uuid="e1384ea11d244bb3b5bbd47634caef19">tempest-TestShelveInstance-676790378-project-member</nova:user>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:project uuid="46c403cd3f6549a3b44268ae4f36fa9b">tempest-TestShelveInstance-676790378</nova:project>
Oct 30 14:13:51 user nova-compute[74319]:       </nova:owner>
Oct 30 14:13:51 user nova-compute[74319]:       <nova:ports>
Oct 30 14:13:51 user nova-compute[74319]:         <nova:port uuid="8f366e93-d46f-45a4-935c-f9b8ac07b031">
Oct 30 14:13:51 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:13:51 user nova-compute[74319]:         </nova:port>
Oct 30 14:13:51 user nova-compute[74319]:       </nova:ports>
Oct 30 14:13:51 user nova-compute[74319]:     </nova:instance>
Oct 30 14:13:51 user nova-compute[74319]:   </metadata>
Oct 30 14:13:51 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:13:51 user nova-compute[74319]:     <system>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="serial">5048109c-d671-4953-b819-fdb69e3052fa</entry>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="uuid">5048109c-d671-4953-b819-fdb69e3052fa</entry>
Oct 30 14:13:51 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:13:51 user nova-compute[74319]:     </system>
Oct 30 14:13:51 user nova-compute[74319]:   </sysinfo>
Oct 30 14:13:51 user nova-compute[74319]:   <os>
Oct 30 14:13:51 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:13:51 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:13:51 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:13:51 user nova-compute[74319]:   </os>
Oct 30 14:13:51 user nova-compute[74319]:   <features>
Oct 30 14:13:51 user nova-compute[74319]:     <acpi/>
Oct 30 14:13:51 user nova-compute[74319]:     <apic/>
Oct 30 14:13:51 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:13:51 user nova-compute[74319]:   </features>
Oct 30 14:13:51 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:13:51 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:13:51 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:13:51 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:13:51 user nova-compute[74319]:   </clock>
Oct 30 14:13:51 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:13:51 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:13:51 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:13:51 user nova-compute[74319]:   </cpu>
Oct 30 14:13:51 user nova-compute[74319]:   <devices>
Oct 30 14:13:51 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:13:51 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:13:51 user nova-compute[74319]:       <source dev="/dev/sdf"/>
Oct 30 14:13:51 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:13:51 user nova-compute[74319]:       <serial>70ec54b9-c9c6-4fd6-8ef0-ac08dedde572</serial>
Oct 30 14:13:51 user nova-compute[74319]:     </disk>
Oct 30 14:13:51 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:13:51 user nova-compute[74319]:       <mac address="fa:16:3e:89:13:6d"/>
Oct 30 14:13:51 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:51 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:13:51 user nova-compute[74319]:       <target dev="tap8f366e93-d4"/>
Oct 30 14:13:51 user nova-compute[74319]:     </interface>
Oct 30 14:13:51 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:13:51 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa/console.log" append="off"/>
Oct 30 14:13:51 user nova-compute[74319]:     </serial>
Oct 30 14:13:51 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:13:51 user nova-compute[74319]:     <video>
Oct 30 14:13:51 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:51 user nova-compute[74319]:     </video>
Oct 30 14:13:51 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:13:51 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:13:51 user nova-compute[74319]:     </rng>
Oct 30 14:13:51 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:13:51 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:13:51 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:13:51 user nova-compute[74319]:     </memballoon>
Oct 30 14:13:51 user nova-compute[74319]:   </devices>
Oct 30 14:13:51 user nova-compute[74319]: </domain>
Oct 30 14:13:51 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdP9qy65aGRzPvBVvvYInx9XgQMNetAWvJWaPPJbeVYG7pja9CsUPMH2bOIPmjS+VJNiMC4Z6ynLByOxDS9HLrMlyaZQNIEJTdw2nNIr2Oq2vqN1M9cy77Ox4vwv+Ivqw==',key_name='tempest-TestShelveInstance-77344443',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:13:29Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG os_vif [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c99b445b-1062-555d-aa94-e7ee6f2faacb', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f366e93-d4, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f366e93-d4, col_values=(('qos', UUID('e211a8c6-81a7-4e84-93f0-e141f4ac203d')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f366e93-d4, col_values=(('external_ids', {'iface-id': '8f366e93-d46f-45a4-935c-f9b8ac07b031', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:13:6d', 'vm-uuid': '5048109c-d671-4953-b819-fdb69e3052fa'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:51 user nova-compute[74319]: INFO os_vif [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4')
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:13:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] No VIF found with MAC fa:16:3e:89:13:6d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:13:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:53 user nova-compute[74319]: WARNING nova.compute.manager [req-0c103ed6-d99d-4fe4-afe0-89ae7e0acd85 req-60055054-750c-45cd-99af-34e85bc30029 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state building and task_state spawning.
Oct 30 14:13:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:13:55 user nova-compute[74319]: WARNING nova.compute.manager [req-fa8e01c9-4240-479b-939f-4fdafd5489d7 req-ed882fd7-2ec5-4097-a7b6-21f541b4cc9f service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state building and task_state spawning.
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:13:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance spawned successfully.
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:13:55 user nova-compute[74319]: INFO nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Took 5.36 seconds to spawn the instance on the hypervisor.
Oct 30 14:13:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:13:55 user nova-compute[74319]: INFO nova.compute.manager [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Took 27.52 seconds to build instance.
Oct 30 14:13:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ca7b527c-4a09-4cd6-8565-efc5e4fab5f7 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.646s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:13:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:13:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquired lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:13:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:13:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'info_cache' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Releasing lock "refresh_cache-43fe7c9d-5a25-455b-8245-6028034d44a9" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:13:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance destroyed successfully.
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'resources' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG os_vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83bbef5-d6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a139de4-5eb4-45b2-89ca-fd419d13a474) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:13:59 user nova-compute[74319]: INFO os_vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start _get_guest_xml network_info=[{"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'numa_topology' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:59 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:59 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'pci_devices' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:13:59 user nova-compute[74319]:   <uuid>43fe7c9d-5a25-455b-8245-6028034d44a9</uuid>
Oct 30 14:13:59 user nova-compute[74319]:   <name>instance-00000019</name>
Oct 30 14:13:59 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:13:59 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:13:59 user nova-compute[74319]:   <metadata>
Oct 30 14:13:59 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:13:59 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeTestJSON-server-447137083</nova:name>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:13:59</nova:creationTime>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:13:59 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:13:59 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:owner>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:user uuid="521f59eb12f844b49a6a727ec38bd016">tempest-AttachVolumeTestJSON-636845633-project-member</nova:user>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:project uuid="42370e22b20540a6b4670bfcc02d62b6">tempest-AttachVolumeTestJSON-636845633</nova:project>
Oct 30 14:13:59 user nova-compute[74319]:       </nova:owner>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:13:59 user nova-compute[74319]:       <nova:ports>
Oct 30 14:13:59 user nova-compute[74319]:         <nova:port uuid="c83bbef5-d67d-4021-8153-e35b9019544e">
Oct 30 14:13:59 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:13:59 user nova-compute[74319]:         </nova:port>
Oct 30 14:13:59 user nova-compute[74319]:       </nova:ports>
Oct 30 14:13:59 user nova-compute[74319]:     </nova:instance>
Oct 30 14:13:59 user nova-compute[74319]:   </metadata>
Oct 30 14:13:59 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:13:59 user nova-compute[74319]:     <system>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="serial">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="uuid">43fe7c9d-5a25-455b-8245-6028034d44a9</entry>
Oct 30 14:13:59 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:13:59 user nova-compute[74319]:     </system>
Oct 30 14:13:59 user nova-compute[74319]:   </sysinfo>
Oct 30 14:13:59 user nova-compute[74319]:   <os>
Oct 30 14:13:59 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:13:59 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:13:59 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:13:59 user nova-compute[74319]:   </os>
Oct 30 14:13:59 user nova-compute[74319]:   <features>
Oct 30 14:13:59 user nova-compute[74319]:     <acpi/>
Oct 30 14:13:59 user nova-compute[74319]:     <apic/>
Oct 30 14:13:59 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:13:59 user nova-compute[74319]:   </features>
Oct 30 14:13:59 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:13:59 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:13:59 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:13:59 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:13:59 user nova-compute[74319]:   </clock>
Oct 30 14:13:59 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:13:59 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:13:59 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:13:59 user nova-compute[74319]:   </cpu>
Oct 30 14:13:59 user nova-compute[74319]:   <devices>
Oct 30 14:13:59 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:13:59 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:13:59 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk"/>
Oct 30 14:13:59 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:13:59 user nova-compute[74319]:     </disk>
Oct 30 14:13:59 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:13:59 user nova-compute[74319]:       <mac address="fa:16:3e:1e:90:5f"/>
Oct 30 14:13:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:59 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:13:59 user nova-compute[74319]:       <target dev="tapc83bbef5-d6"/>
Oct 30 14:13:59 user nova-compute[74319]:     </interface>
Oct 30 14:13:59 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:13:59 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/console.log" append="off"/>
Oct 30 14:13:59 user nova-compute[74319]:     </serial>
Oct 30 14:13:59 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:13:59 user nova-compute[74319]:     <video>
Oct 30 14:13:59 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:13:59 user nova-compute[74319]:     </video>
Oct 30 14:13:59 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:13:59 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:13:59 user nova-compute[74319]:     </rng>
Oct 30 14:13:59 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:13:59 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:13:59 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:13:59 user nova-compute[74319]:     </memballoon>
Oct 30 14:13:59 user nova-compute[74319]:   </devices>
Oct 30 14:13:59 user nova-compute[74319]: </domain>
Oct 30 14:13:59 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:13:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.250s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Cannot resize image /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'migration_context' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.objects.base [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Object Instance<43fe7c9d-5a25-455b-8245-6028034d44a9> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:12:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG os_vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d3d476c-66a5-53c5-920b-03bf2e5c0ad7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc83bbef5-d6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc83bbef5-d6, col_values=(('qos', UUID('9092c7a7-242a-40c3-9ea6-86eee3f48d9b')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc83bbef5-d6, col_values=(('external_ids', {'iface-id': 'c83bbef5-d67d-4021-8153-e35b9019544e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:90:5f', 'vm-uuid': '43fe7c9d-5a25-455b-8245-6028034d44a9'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:00 user nova-compute[74319]: INFO os_vif [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:02 user nova-compute[74319]: WARNING nova.compute.manager [req-20893570-4031-423d-a8b2-1a24851b0fc1 req-2d8217f4-5ad7-4d6a-ba12-9f66ea38a59c service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state stopped and task_state powering-on.
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:14:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance rebooted successfully.
Oct 30 14:14:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-212c522b-4e7a-4525-ad98-a61cbd7c39dd tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:04 user nova-compute[74319]: WARNING nova.compute.manager [req-7af7d7a6-5f44-49be-a2fa-8366f47dd07d req-a711137e-d2ee-4feb-a8cf-e6b7e43633af service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state stopped and task_state powering-on.
Oct 30 14:14:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:09 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ebb16e81-4daa-447a-9d83-7a51c0e56745 is timed out.
Oct 30 14:14:09 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Successfully detached device vdb from instance ebb16e81-4daa-447a-9d83-7a51c0e56745 from the live domain config.
Oct 30 14:14:09 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ADgEvbGH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:14:09 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a46b50-6ce9-4431-bb80-208e4149c920]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:14:09 user nova-compute[74319]: No targets found.
Oct 30 14:14:09 user nova-compute[74319]: iSNS:
Oct 30 14:14:09 user nova-compute[74319]: No targets found.
Oct 30 14:14:09 user nova-compute[74319]: STATIC:
Oct 30 14:14:09 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005
Oct 30 14:14:09 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:09 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:09 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:14:09 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:09 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:09 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:14:09 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:09 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:09 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:14:09 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:09 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:09 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:14:09 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:09 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:09 user nova-compute[74319]: FIRMWARE:
Oct 30 14:14:09 user nova-compute[74319]: No targets found.
Oct 30 14:14:09 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:14:09 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:14:09 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b50b16a-9ebf-487a-bf80-0f0eca0f6cec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31768ba-fb5e-48df-9426-f9f5d0e2abc9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:09 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a0151b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d675f4d6-90bb-4fe7-9ce5-a1f71d515e60]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:14:09 user nova-compute[74319]: INFO nova.compute.claims [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Claim successful on node user
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab7536-0fbd-4ce3-93be-7cbab6698268]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e48543-98e1-484e-b4bb-841f0984ca7f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37c02cb-9fcd-4261-882f-e74151f8de08]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.066s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec73856-5849-4496-8c2e-c889f35c49a6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b8cd76-962d-4cfc-9e87-7bceecdc6537]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260]
Oct 30 14:14:09 user nova-compute[74319]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005, portal: 172.16.0.220,3260] successful.
Oct 30 14:14:09 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a37d98-8165-4671-9d11-45ea25d4b005 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dcae3a-2717-4013-af9e-a645bf7755fd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.501s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] <== disconnect_volume: return (504ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:14:09 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.997s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:14:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:14:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.policy [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0c7aa0d23b06429a979030bc57f68027', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e304f9766008483988dba2ef27b88eb6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:14:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Creating image(s)
Oct 30 14:14:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "/opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "/opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "/opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:10 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.217s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lazy-loading 'flavor' on Instance uuid ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d6dffbfd-4377-4cfa-a9a1-199e2803c72e tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.575s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.252s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk 1073741824" returned: 0 in 0.068s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.290s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Successfully created port: 3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Cannot resize image /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Ensure instance console log exists: /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Successfully updated port: 3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquired lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-changed-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Refreshing instance network info cache due to event network-changed-3a745c2c-4c94-49d3-a7e3-44efaa673040. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] Acquiring lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.network.neutron [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updating instance_info_cache with network_info: [{"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Releasing lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Instance network_info: |[{"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] Acquired lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.network.neutron [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Refreshing network info cache for port 3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:14:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Start _get_guest_xml network_info=[{"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:14:13 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:13 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1537828393',display_name='tempest-VolumesSnapshotTestJSON-instance-1537828393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1537828393',id=34,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgionHXrHJgR6pdJv3PyKSUwBOfEQZnnGT+XBGdE/nIwvjUNqDR2qe1J8Jl2g4BBfqFAad2QGqGBuZnWeYvUbyftZ6IBSMmrtdhdmync5wNOUyKCiAtR7lW7UyvBgXznw==',key_name='tempest-keypair-1618853568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-12hi7c72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=85d79bce-38a7-4708-ae18-22467ad15886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.objects.instance [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'pci_devices' on Instance uuid 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:14:13 user nova-compute[74319]:   <uuid>85d79bce-38a7-4708-ae18-22467ad15886</uuid>
Oct 30 14:14:13 user nova-compute[74319]:   <name>instance-00000022</name>
Oct 30 14:14:13 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:14:13 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:14:13 user nova-compute[74319]:   <metadata>
Oct 30 14:14:13 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:14:13 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1537828393</nova:name>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:14:13</nova:creationTime>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:14:13 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:14:13 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:owner>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:user uuid="0c7aa0d23b06429a979030bc57f68027">tempest-VolumesSnapshotTestJSON-1843196762-project-member</nova:user>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:project uuid="e304f9766008483988dba2ef27b88eb6">tempest-VolumesSnapshotTestJSON-1843196762</nova:project>
Oct 30 14:14:13 user nova-compute[74319]:       </nova:owner>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:14:13 user nova-compute[74319]:       <nova:ports>
Oct 30 14:14:13 user nova-compute[74319]:         <nova:port uuid="3a745c2c-4c94-49d3-a7e3-44efaa673040">
Oct 30 14:14:13 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:14:13 user nova-compute[74319]:         </nova:port>
Oct 30 14:14:13 user nova-compute[74319]:       </nova:ports>
Oct 30 14:14:13 user nova-compute[74319]:     </nova:instance>
Oct 30 14:14:13 user nova-compute[74319]:   </metadata>
Oct 30 14:14:13 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:14:13 user nova-compute[74319]:     <system>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="serial">85d79bce-38a7-4708-ae18-22467ad15886</entry>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="uuid">85d79bce-38a7-4708-ae18-22467ad15886</entry>
Oct 30 14:14:13 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:14:13 user nova-compute[74319]:     </system>
Oct 30 14:14:13 user nova-compute[74319]:   </sysinfo>
Oct 30 14:14:13 user nova-compute[74319]:   <os>
Oct 30 14:14:13 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:14:13 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:14:13 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:14:13 user nova-compute[74319]:   </os>
Oct 30 14:14:13 user nova-compute[74319]:   <features>
Oct 30 14:14:13 user nova-compute[74319]:     <acpi/>
Oct 30 14:14:13 user nova-compute[74319]:     <apic/>
Oct 30 14:14:13 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:14:13 user nova-compute[74319]:   </features>
Oct 30 14:14:13 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:14:13 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:14:13 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:14:13 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:14:13 user nova-compute[74319]:   </clock>
Oct 30 14:14:13 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:14:13 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:14:13 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:14:13 user nova-compute[74319]:   </cpu>
Oct 30 14:14:13 user nova-compute[74319]:   <devices>
Oct 30 14:14:13 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:14:13 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:14:13 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk"/>
Oct 30 14:14:13 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:14:13 user nova-compute[74319]:     </disk>
Oct 30 14:14:13 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:14:13 user nova-compute[74319]:       <mac address="fa:16:3e:17:08:c0"/>
Oct 30 14:14:13 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:13 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:14:13 user nova-compute[74319]:       <target dev="tap3a745c2c-4c"/>
Oct 30 14:14:13 user nova-compute[74319]:     </interface>
Oct 30 14:14:13 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:14:13 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/console.log" append="off"/>
Oct 30 14:14:13 user nova-compute[74319]:     </serial>
Oct 30 14:14:13 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:14:13 user nova-compute[74319]:     <video>
Oct 30 14:14:13 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:13 user nova-compute[74319]:     </video>
Oct 30 14:14:13 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:14:13 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:14:13 user nova-compute[74319]:     </rng>
Oct 30 14:14:13 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:14:13 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:14:13 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:14:13 user nova-compute[74319]:     </memballoon>
Oct 30 14:14:13 user nova-compute[74319]:   </devices>
Oct 30 14:14:13 user nova-compute[74319]: </domain>
Oct 30 14:14:13 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1537828393',display_name='tempest-VolumesSnapshotTestJSON-instance-1537828393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1537828393',id=34,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgionHXrHJgR6pdJv3PyKSUwBOfEQZnnGT+XBGdE/nIwvjUNqDR2qe1J8Jl2g4BBfqFAad2QGqGBuZnWeYvUbyftZ6IBSMmrtdhdmync5wNOUyKCiAtR7lW7UyvBgXznw==',key_name='tempest-keypair-1618853568',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-12hi7c72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=85d79bce-38a7-4708-ae18-22467ad15886,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG os_vif [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '362c2c08-0327-5aa1-ac21-621899c05774', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a745c2c-4c, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a745c2c-4c, col_values=(('qos', UUID('8b4b478d-0cb4-466e-a64a-15a79aed863a')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a745c2c-4c, col_values=(('external_ids', {'iface-id': '3a745c2c-4c94-49d3-a7e3-44efaa673040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:08:c0', 'vm-uuid': '85d79bce-38a7-4708-ae18-22467ad15886'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:13 user nova-compute[74319]: INFO os_vif [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c')
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No VIF found with MAC fa:16:3e:17:08:c0, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.neutron [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updated VIF entry in instance network info cache for port 3a745c2c-4c94-49d3-a7e3-44efaa673040. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG nova.network.neutron [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updating instance_info_cache with network_info: [{"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-306f12bc-c637-4de8-876c-93fe49e94922 req-b45bab15-1b1d-49c3-9507-e96868b0e29d service nova] Releasing lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] No waiting events found dispatching network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:14 user nova-compute[74319]: WARNING nova.compute.manager [req-f89ce1d9-d2a3-4672-a760-3455180e8e56 req-843f5315-28a6-4d93-bf82-20cae91e4b88 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received unexpected event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 for instance with vm_state building and task_state spawning.
Oct 30 14:14:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing instance network info cache due to event network-changed-ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Refreshing network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:14:16 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Instance spawned successfully.
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:16 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] No waiting events found dispatching network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:17 user nova-compute[74319]: WARNING nova.compute.manager [req-0275304f-480d-4668-8a71-5b4717e14fa4 req-2fa44b32-2b7a-4d41-b2b6-1179fb3365f8 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received unexpected event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 for instance with vm_state building and task_state spawning.
Oct 30 14:14:17 user nova-compute[74319]: INFO nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Took 6.23 seconds to spawn the instance on the hypervisor.
Oct 30 14:14:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated VIF entry in instance network info cache for port ad5624f5-c85a-4fe9-9388-c45039fd474c. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-50d76b9b-f4d6-4c46-9c7a-9a10ca6be9ee req-ac9a1a58-3913-4849-85c1-d9893dccbc7c service nova] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:17 user nova-compute[74319]: INFO nova.compute.manager [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Took 7.69 seconds to build instance.
Oct 30 14:14:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-81b98ed5-784b-4774-bab5-1b3cc9d3b62f tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.827s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-changed-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Refreshing instance network info cache due to event network-changed-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Refreshing network info cache for port bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Stashing vm_state: active {{(pid=74319) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updated VIF entry in instance network info cache for port bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbcdc217-a1b0-4f7e-b595-4658fece8f27 req-d3cc6f1c-a32c-485f-982f-37c0add830c4 service nova] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:14:19 user nova-compute[74319]: INFO nova.compute.claims [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Claim successful on node user
Oct 30 14:14:19 user nova-compute[74319]: INFO nova.compute.resource_tracker [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating resource usage from migration c28be1e6-75f1-4f31-8884-100f3498b929
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.472s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:19 user nova-compute[74319]: INFO nova.compute.manager [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Migrating
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:19 user nova-compute[74319]: INFO nova.compute.rpcapi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:19 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Starting migrate_disk_and_power_off {{(pid=74319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:20 user nova-compute[74319]: WARNING nova.compute.manager [req-2ba9e1e1-d46b-44f2-a672-15e25677d6de req-9f7b79b6-c09f-4233-a316-083080c55229 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance destroyed successfully.
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:12:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfa6539d-c8, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb21eda4-a5b3-4829-9dcf-02eb288982f5) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: INFO os_vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8')
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:14:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[210d23f8-4675-4549-bf80-36ced0598c8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:14:21 user nova-compute[74319]: No targets found.
Oct 30 14:14:21 user nova-compute[74319]: iSNS:
Oct 30 14:14:21 user nova-compute[74319]: No targets found.
Oct 30 14:14:21 user nova-compute[74319]: STATIC:
Oct 30 14:14:21 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:14:21 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:21 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:21 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:14:21 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:21 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:21 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:14:21 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:21 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:21 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:14:21 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:14:21 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:14:21 user nova-compute[74319]: FIRMWARE:
Oct 30 14:14:21 user nova-compute[74319]: No targets found.
Oct 30 14:14:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:14:21 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:14:21 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[029122ab-327f-43ba-9124-c3bf0b9b4190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c36fb-50d5-4954-b450-73d90ff8bf6e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9745143a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2f2029-235f-4c0f-943c-91b8da9dbe03]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[595202e1-735a-4076-8211-456ee84534f8]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[930c8adb-bd1d-46df-ae7c-dcdc5dd6df37]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[51605987-5149-4bbf-b8ab-a647ccc1fe38]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d464a52-a3fc-4f71-a474-4b8ff2e94002]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[421df33f-1b00-4a67-8de4-a0ce4e7e4558]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]
Oct 30 14:14:21 user nova-compute[74319]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.
Oct 30 14:14:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f694d-eb3d-4807-94ea-72c79374f164]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== disconnect_volume: return (362ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:22 user nova-compute[74319]: WARNING nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:22 user nova-compute[74319]: WARNING nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:22 user nova-compute[74319]: WARNING nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:22 user nova-compute[74319]: WARNING nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:22 user nova-compute[74319]: WARNING nova.compute.manager [req-53751d3e-1e05-499d-b4be-bdf9799a01f1 req-37f38f58-f1e6-4e27-892e-9b9975c250eb service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_migrating.
Oct 30 14:14:22 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Port bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f binding to destination host user is already ACTIVE {{(pid=74319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bdc2f7-d88d-406f-91d5-68c9fdf2a5e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388b7f3-6b7b-4f4c-9f27-a517da855876]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd6ceee-f259-49b6-9869-4f2e03523b09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb90c23-1cc0-4546-b0cf-9cdd2a916924]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:14:23 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:14:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c519bb-b1fe-4964-a4cd-4dad96274e33]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:14:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:14:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:30 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:14:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:14:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:33 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7726MB free_disk=25.121646881103516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:33 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Applying migration context for instance 78691de8-10df-403c-91d2-afc7594a413d as it has an incoming, in-progress migration c28be1e6-75f1-4f31-8884-100f3498b929. Migration status is post-migrating {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 14:14:33 user nova-compute[74319]: INFO nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating resource usage from migration c28be1e6-75f1-4f31-8884-100f3498b929
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ebb16e81-4daa-447a-9d83-7a51c0e56745 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5048109c-d671-4953-b819-fdb69e3052fa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85d79bce-38a7-4708-ae18-22467ad15886 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Migration c28be1e6-75f1-4f31-8884-100f3498b929 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:14:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:14:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Starting finish_migration {{(pid=74319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:14:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Creating image(s)
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Ensure instance console log exists: /opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start _get_guest_xml network_info=[{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '4d8d880b-e616-469d-a85d-60f1b7bbe4fa', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '78691de8-10df-403c-91d2-afc7594a413d', 'attached_at': '2023-10-30T14:14:44.000000', 'detached_at': '', 'volume_id': '1633576e-e50b-4953-b9b6-ab8c9d430b31', 'serial': '1633576e-e50b-4953-b9b6-ab8c9d430b31'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:14:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:34Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:14:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:14:43 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:14:43 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378b61c-a98f-49f6-b679-31b58d811de6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:14:43 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d929d62-a690-432d-8c5a-647f790ac54b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31] added
Oct 30 14:14:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9a003a-434f-45ca-a9cd-211238f9d883]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ceecb4-de31-45bb-b06e-64438d1d6d3e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAMyJLIx {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WAMyJLIx" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[102a5a73-b287-4a2a-a808-51ba721fad2c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WAMyJLIx'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff726fd-771a-45bc-89ab-41792cdd86fd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11893bc-f759-4978-879e-54e587e5183d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d79b12f-da47-4218-9d63-0fc9cf0cde86]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]
Oct 30 14:14:44 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.
Oct 30 14:14:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c741f23-17d9-4e0d-b482-ad100d13e88a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f327db41-7594-45c5-a1f2-0294875f0bcd]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:14:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc3b8dc-7747-4f80-8c56-58dda23df050]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:14:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23038666166393033', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038666166393033', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:12:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:14:45 user nova-compute[74319]:   <uuid>78691de8-10df-403c-91d2-afc7594a413d</uuid>
Oct 30 14:14:45 user nova-compute[74319]:   <name>instance-0000001f</name>
Oct 30 14:14:45 user nova-compute[74319]:   <memory>2097152</memory>
Oct 30 14:14:45 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:14:45 user nova-compute[74319]:   <metadata>
Oct 30 14:14:45 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:14:45 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:14:45 user nova-compute[74319]:       <nova:name>tempest-ServerActionsTestOtherA-server-16653019</nova:name>
Oct 30 14:14:45 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:14:43</nova:creationTime>
Oct 30 14:14:45 user nova-compute[74319]:       <nova:flavor name="m1.small">
Oct 30 14:14:45 user nova-compute[74319]:         <nova:memory>2048</nova:memory>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:disk>20</nova:disk>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:14:45 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:14:45 user nova-compute[74319]:       <nova:owner>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:user uuid="d03a462b75b14b4fb30f66a3b0e051d4">tempest-ServerActionsTestOtherA-768990641-project-member</nova:user>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:project uuid="0ae8f2e2f199408596776c53c41a7986">tempest-ServerActionsTestOtherA-768990641</nova:project>
Oct 30 14:14:45 user nova-compute[74319]:       </nova:owner>
Oct 30 14:14:45 user nova-compute[74319]:       <nova:ports>
Oct 30 14:14:45 user nova-compute[74319]:         <nova:port uuid="bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f">
Oct 30 14:14:45 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:14:45 user nova-compute[74319]:         </nova:port>
Oct 30 14:14:45 user nova-compute[74319]:       </nova:ports>
Oct 30 14:14:45 user nova-compute[74319]:     </nova:instance>
Oct 30 14:14:45 user nova-compute[74319]:   </metadata>
Oct 30 14:14:45 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:14:45 user nova-compute[74319]:     <system>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="serial">78691de8-10df-403c-91d2-afc7594a413d</entry>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="uuid">78691de8-10df-403c-91d2-afc7594a413d</entry>
Oct 30 14:14:45 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:14:45 user nova-compute[74319]:     </system>
Oct 30 14:14:45 user nova-compute[74319]:   </sysinfo>
Oct 30 14:14:45 user nova-compute[74319]:   <os>
Oct 30 14:14:45 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:14:45 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:14:45 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:14:45 user nova-compute[74319]:   </os>
Oct 30 14:14:45 user nova-compute[74319]:   <features>
Oct 30 14:14:45 user nova-compute[74319]:     <acpi/>
Oct 30 14:14:45 user nova-compute[74319]:     <apic/>
Oct 30 14:14:45 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:14:45 user nova-compute[74319]:   </features>
Oct 30 14:14:45 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:14:45 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:14:45 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:14:45 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:14:45 user nova-compute[74319]:   </clock>
Oct 30 14:14:45 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:14:45 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:14:45 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:14:45 user nova-compute[74319]:   </cpu>
Oct 30 14:14:45 user nova-compute[74319]:   <devices>
Oct 30 14:14:45 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:14:45 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:14:45 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:14:45 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:14:45 user nova-compute[74319]:       <serial>1633576e-e50b-4953-b9b6-ab8c9d430b31</serial>
Oct 30 14:14:45 user nova-compute[74319]:     </disk>
Oct 30 14:14:45 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:14:45 user nova-compute[74319]:       <mac address="fa:16:3e:a6:cd:72"/>
Oct 30 14:14:45 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:45 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:14:45 user nova-compute[74319]:       <target dev="tapbfa6539d-c8"/>
Oct 30 14:14:45 user nova-compute[74319]:     </interface>
Oct 30 14:14:45 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:14:45 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d/console.log" append="off"/>
Oct 30 14:14:45 user nova-compute[74319]:     </serial>
Oct 30 14:14:45 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:14:45 user nova-compute[74319]:     <video>
Oct 30 14:14:45 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:45 user nova-compute[74319]:     </video>
Oct 30 14:14:45 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:14:45 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:14:45 user nova-compute[74319]:     </rng>
Oct 30 14:14:45 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:14:45 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:14:45 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:14:45 user nova-compute[74319]:     </memballoon>
Oct 30 14:14:45 user nova-compute[74319]:   </devices>
Oct 30 14:14:45 user nova-compute[74319]: </domain>
Oct 30 14:14:45 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:12:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2051465681-network", "vif_mac": "fa:16:3e:a6:cd:72"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG os_vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '372a00b4-9a11-5a70-b423-7feced7390cc', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfa6539d-c8, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfa6539d-c8, col_values=(('qos', UUID('e46aab88-f428-4803-8d94-8aaad0400920')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfa6539d-c8, col_values=(('external_ids', {'iface-id': 'bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:cd:72', 'vm-uuid': '78691de8-10df-403c-91d2-afc7594a413d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:45 user nova-compute[74319]: INFO os_vif [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8')
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] No VIF found with MAC fa:16:3e:a6:cd:72, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:14:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:47 user nova-compute[74319]: WARNING nova.compute.manager [req-bbc4cb0f-e273-4bfd-9fbd-2fcfec59e54c req-d1b8c490-53b6-4ad6-855e-5a84b4b22d90 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_finish.
Oct 30 14:14:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:48 user nova-compute[74319]: INFO nova.compute.manager [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Unshelving
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_requests' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:14:49 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance running successfully.
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'numa_topology' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Failed to set time: agent not configured {{(pid=74319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e52eb967-81aa-44d9-8e1d-616e039d71e2 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] finish_migration finished successfully. {{(pid=74319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:14:49 user nova-compute[74319]: INFO nova.compute.claims [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Claim successful on node user
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.compute.manager [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:49 user nova-compute[74319]: WARNING nova.compute.manager [req-430fa39d-a702-41d5-9086-f41c66bc0f3b req-c65d1d6f-57d5-4d15-9852-353df3334277 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state resize_finish.
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:14:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:49 user nova-compute[74319]: INFO nova.network.neutron [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating port 7007b011-9b96-4a02-b69e-2e4b401fb2af with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing instance network info cache due to event network-changed-7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] Acquiring lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:14:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Creating image(s)
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'trusted_certs' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] Acquired lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Refreshing network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<acbcf291-490e-454c-bed2-197e923d657e> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:52 user nova-compute[74319]: INFO nova.compute.manager [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Terminating instance
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.virt.images [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] 6fb00cb7-5856-43ab-adf2-55f67bf11077 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.part /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.network.neutron [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updated VIF entry in instance network info cache for port 7007b011-9b96-4a02-b69e-2e4b401fb2af. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.network.neutron [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-444b3dbb-30c4-4af5-bfa2-d29b4e9185f2 req-b9e48b65-1175-45ad-83ca-5d1080236ec0 service nova] Releasing lock "refresh_cache-acbcf291-490e-454c-bed2-197e923d657e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.part /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.converted" returned: 0 in 0.355s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-unplugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] No waiting events found dispatching network-vif-unplugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-22076637-6285-4e48-b2d3-f4d352b2cb73 req-975ad567-4018-4ff6-afa4-b56bb7ac600e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-unplugged-471b5916-5ef5-4400-8205-10993f68339e for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.939s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Instance destroyed successfully.
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lazy-loading 'resources' on Instance uuid ebb16e81-4daa-447a-9d83-7a51c0e56745 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:11:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-47993577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-4799357',id=30,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+H4FdKjc5S/PepHwpG8KSNrxZUQqsOCLpq0jA75uVc3opf7iQKDl3/x2IRiAq98EmA4BVmZNsnVfGdG6V0LTjAEYgqXoQbpaex9oHhBznpY98AsHo5uyHrZ4iBolIByA==',key_name='tempest-keypair-632544931',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='183376a76f7b4f6384593abf1714f239',ramdisk_id='',reservation_id='r-k0wwknfl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:11:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e8041d43400745a49af0cdd143a7fa96',uuid=ebb16e81-4daa-447a-9d83-7a51c0e56745,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converting VIF {"id": "471b5916-5ef5-4400-8205-10993f68339e", "address": "fa:16:3e:aa:40:c0", "network": {"id": "17f5d91e-8736-47bf-9801-9f16a93b404e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1392021294-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "183376a76f7b4f6384593abf1714f239", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap471b5916-5e", "ovs_interfaceid": "471b5916-5ef5-4400-8205-10993f68339e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG os_vif [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap471b5916-5e, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0fc034e3-8bad-47b6-83b4-264233864c88) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:53 user nova-compute[74319]: INFO os_vif [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:40:c0,bridge_name='br-int',has_traffic_filtering=True,id=471b5916-5ef5-4400-8205-10993f68339e,network=Network(17f5d91e-8736-47bf-9801-9f16a93b404e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap471b5916-5e')
Oct 30 14:14:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Deleting instance files /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745_del
Oct 30 14:14:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Deletion of /opt/stack/data/nova/instances/ebb16e81-4daa-447a-9d83-7a51c0e56745_del complete
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478,backing_fmt=raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478,backing_fmt=raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk 1073741824" returned: 0 in 0.047s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "9b47bec5963db47a4c6f25ce5e505392fafdd478" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:53 user nova-compute[74319]: INFO nova.compute.manager [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'migration_context' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<acbcf291-490e-454c-bed2-197e923d657e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Rebasing disk image.
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d -F raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:14:54 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Took 0.77 seconds to deallocate network for instance.
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] Acquiring lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] No waiting events found dispatching network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:54 user nova-compute[74319]: WARNING nova.compute.manager [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received unexpected event network-vif-plugged-471b5916-5ef5-4400-8205-10993f68339e for instance with vm_state deleted and task_state None.
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-287633d5-4c5d-47ba-a132-d31b6540250f req-5d4536de-4565-405b-81f4-6196f4d0736e service nova] [instance: ebb16e81-4daa-447a-9d83-7a51c0e56745] Received event network-vif-deleted-471b5916-5ef5-4400-8205-10993f68339e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:14:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.758s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:55 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Deleted allocations for instance ebb16e81-4daa-447a-9d83-7a51c0e56745
Oct 30 14:14:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3c766f75-9751-4bdb-98b0-34587e2cefe1 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977 tempest-TestServerVolumeAttachScenarioOldVersion-1997443977-project-member] Lock "ebb16e81-4daa-447a-9d83-7a51c0e56745" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.185s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d -F raw /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk" returned: 0 in 2.380s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Ensure instance console log exists: /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start _get_guest_xml network_info=[{"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5138f6cb5410e5081cccce0b7f195d51',container_format='bare',created_at=2023-10-30T14:12:55Z,direct_url=<?>,disk_format='qcow2',id=6fb00cb7-5856-43ab-adf2-55f67bf11077,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1427360873-shelved',owner='e173b99e7da54c6688ccc9969dbaa7f4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:13:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:14:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5138f6cb5410e5081cccce0b7f195d51',container_format='bare',created_at=2023-10-30T14:12:55Z,direct_url=<?>,disk_format='qcow2',id=6fb00cb7-5856-43ab-adf2-55f67bf11077,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1427360873-shelved',owner='e173b99e7da54c6688ccc9969dbaa7f4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:13:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'vcpu_model' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<acbcf291-490e-454c-bed2-197e923d657e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6fb00cb7-5856-43ab-adf2-55f67bf11077',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1424537780',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:13:00.083928',shelved_host='user',shelved_image_id='6fb00cb7-5856-43ab-adf2-55f67bf11077'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'pci_devices' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Object Instance<acbcf291-490e-454c-bed2-197e923d657e> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:14:56 user nova-compute[74319]:   <uuid>acbcf291-490e-454c-bed2-197e923d657e</uuid>
Oct 30 14:14:56 user nova-compute[74319]:   <name>instance-0000001d</name>
Oct 30 14:14:56 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:14:56 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:14:56 user nova-compute[74319]:   <metadata>
Oct 30 14:14:56 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:14:56 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1427360873</nova:name>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:14:56</nova:creationTime>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:14:56 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:14:56 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:owner>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:user uuid="72f5d276e62a472b92e46d28aa5a5286">tempest-AttachVolumeShelveTestJSON-282209841-project-member</nova:user>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:project uuid="e173b99e7da54c6688ccc9969dbaa7f4">tempest-AttachVolumeShelveTestJSON-282209841</nova:project>
Oct 30 14:14:56 user nova-compute[74319]:       </nova:owner>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:root type="image" uuid="6fb00cb7-5856-43ab-adf2-55f67bf11077"/>
Oct 30 14:14:56 user nova-compute[74319]:       <nova:ports>
Oct 30 14:14:56 user nova-compute[74319]:         <nova:port uuid="7007b011-9b96-4a02-b69e-2e4b401fb2af">
Oct 30 14:14:56 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 30 14:14:56 user nova-compute[74319]:         </nova:port>
Oct 30 14:14:56 user nova-compute[74319]:       </nova:ports>
Oct 30 14:14:56 user nova-compute[74319]:     </nova:instance>
Oct 30 14:14:56 user nova-compute[74319]:   </metadata>
Oct 30 14:14:56 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:14:56 user nova-compute[74319]:     <system>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="serial">acbcf291-490e-454c-bed2-197e923d657e</entry>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="uuid">acbcf291-490e-454c-bed2-197e923d657e</entry>
Oct 30 14:14:56 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:14:56 user nova-compute[74319]:     </system>
Oct 30 14:14:56 user nova-compute[74319]:   </sysinfo>
Oct 30 14:14:56 user nova-compute[74319]:   <os>
Oct 30 14:14:56 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:14:56 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:14:56 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:14:56 user nova-compute[74319]:   </os>
Oct 30 14:14:56 user nova-compute[74319]:   <features>
Oct 30 14:14:56 user nova-compute[74319]:     <acpi/>
Oct 30 14:14:56 user nova-compute[74319]:     <apic/>
Oct 30 14:14:56 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:14:56 user nova-compute[74319]:   </features>
Oct 30 14:14:56 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:14:56 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:14:56 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:14:56 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:14:56 user nova-compute[74319]:   </clock>
Oct 30 14:14:56 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:14:56 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:14:56 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:14:56 user nova-compute[74319]:   </cpu>
Oct 30 14:14:56 user nova-compute[74319]:   <devices>
Oct 30 14:14:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:14:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:14:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk"/>
Oct 30 14:14:56 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:14:56 user nova-compute[74319]:     </disk>
Oct 30 14:14:56 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:14:56 user nova-compute[74319]:       <mac address="fa:16:3e:52:e6:ec"/>
Oct 30 14:14:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:56 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:14:56 user nova-compute[74319]:       <target dev="tap7007b011-9b"/>
Oct 30 14:14:56 user nova-compute[74319]:     </interface>
Oct 30 14:14:56 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:14:56 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/console.log" append="off"/>
Oct 30 14:14:56 user nova-compute[74319]:     </serial>
Oct 30 14:14:56 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:14:56 user nova-compute[74319]:     <video>
Oct 30 14:14:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:14:56 user nova-compute[74319]:     </video>
Oct 30 14:14:56 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:14:56 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:14:56 user nova-compute[74319]:     </rng>
Oct 30 14:14:56 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:14:56 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:14:56 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:14:56 user nova-compute[74319]:     </memballoon>
Oct 30 14:14:56 user nova-compute[74319]:   </devices>
Oct 30 14:14:56 user nova-compute[74319]: </domain>
Oct 30 14:14:56 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6fb00cb7-5856-43ab-adf2-55f67bf11077',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1424537780',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:11:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member',shelved_at='2023-10-30T14:13:00.083928',shelved_host='user',shelved_image_id='6fb00cb7-5856-43ab-adf2-55f67bf11077'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:14:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG os_vif [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '18203bd8-c56a-5662-ab1a-6440a19e26d1', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7007b011-9b, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7007b011-9b, col_values=(('qos', UUID('c3063037-4f84-4db3-bff4-38a1877a4ad1')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7007b011-9b, col_values=(('external_ids', {'iface-id': '7007b011-9b96-4a02-b69e-2e4b401fb2af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:e6:ec', 'vm-uuid': 'acbcf291-490e-454c-bed2-197e923d657e'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:56 user nova-compute[74319]: INFO os_vif [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b')
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:14:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] No VIF found with MAC fa:16:3e:52:e6:ec, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:57 user nova-compute[74319]: WARNING nova.compute.manager [req-97cf00a0-9e1a-4148-b1a0-4b27eeb0e844 req-b3341e26-bdbb-47ff-82c6-975013f05ce8 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:14:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:14:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:14:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:14:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:14:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:14:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:14:59 user nova-compute[74319]: WARNING nova.compute.manager [req-9652996a-5f18-4df4-b1d8-b6a5b559b31a req-583d3319-7c41-4270-9ca0-a5b8add61c07 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:15:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:15:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:15:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance spawned successfully.
Oct 30 14:15:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:15:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0679f43-9012-4921-9d89-66705b2d1741 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.765s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:10 user nova-compute[74319]: INFO nova.compute.manager [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Rescuing
Oct 30 14:15:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:15:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:15:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:15:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating instance_info_cache with network_info: [{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG nova.compute.manager [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG nova.compute.manager [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:11 user nova-compute[74319]: WARNING nova.compute.manager [req-afaaadbf-b18d-46bf-be31-9bf837b6a8df req-0ac0626f-3161-4aa5-91c9-0bc4e6dab94b service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state active and task_state rescuing.
Oct 30 14:15:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance destroyed successfully.
Oct 30 14:15:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Attempting a stable device rescue
Oct 30 14:15:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:15:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Creating image(s)
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:12 user nova-compute[74319]: DEBUG nova.virt.images [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] 42423556-6490-4467-b86d-69ccac93e257 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.part /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.part /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.converted" returned: 0 in 0.552s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:13 user nova-compute[74319]: WARNING nova.compute.manager [req-05fa1a33-058a-4462-8d79-bcfa118c794f req-1cb24760-5a1b-4b26-8769-7ac3f29fed74 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state active and task_state rescuing.
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.828s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6 --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6,backing_fmt=raw /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6,backing_fmt=raw /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue" returned: 0 in 0.055s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "d759f4db8f7bee3280c5244b54a12a6a84094fd6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'migration_context' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<5820195e-e4d1-44a4-86d8-25f003fca44a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start _get_guest_xml network_info=[{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:2c:39:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '42423556-6490-4467-b86d-69ccac93e257', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '7c1f42fe-001d-44f5-a992-2e90b82ac7f3', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5820195e-e4d1-44a4-86d8-25f003fca44a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'serial': 'ace075d9-7d66-4eda-a20b-def23d6c2ec0'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<5820195e-e4d1-44a4-86d8-25f003fca44a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'numa_topology' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<5820195e-e4d1-44a4-86d8-25f003fca44a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:14 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:15:14 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<5820195e-e4d1-44a4-86d8-25f003fca44a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:15:14 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:15:14 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:15:14 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d82ef7-36fe-4032-99d8-42727bcdfa65]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = idBqLVkx\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 30 14:15:14 user nova-compute[74319]: node.name = iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:15:14 user nova-compute[74319]: node.tpgt = -1
Oct 30 14:15:14 user nova-compute[74319]: node.startup = automatic
Oct 30 14:15:14 user nova-compute[74319]: node.leading_login = No
Oct 30 14:15:14 user nova-compute[74319]: iface.iscsi_ifacename = default
Oct 30 14:15:14 user nova-compute[74319]: iface.net_ifacename = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.ipaddress = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.prefix_len = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.hwaddress = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.transport_name = tcp
Oct 30 14:15:14 user nova-compute[74319]: iface.initiatorname = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.vlan_id = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.vlan_priority = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.vlan_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.iface_num = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.mtu = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.port = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.bootproto = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.subnet_mask = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.gateway = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_alt_client_id_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_alt_client_id = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_dns = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_learn_iqn = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_req_vendor_id_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_vendor_id_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_vendor_id = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.dhcp_slp_da = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.fragmentation = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.gratuitous_arp = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.incoming_forwarding = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.tos_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.tos = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.ttl = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.delayed_ack = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.tcp_nagle = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.tcp_wsf_state = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.tcp_wsf = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.tcp_timer_scale = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.tcp_timestamp = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.redirect = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.def_task_mgmt_timeout = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.header_digest = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.data_digest = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.immediate_data = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.initial_r2t = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.data_seq_inorder = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.data_pdu_inorder = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.erl = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.max_receive_data_len = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.first_burst_len = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.max_outstanding_r2t = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.max_burst_len = 0
Oct 30 14:15:14 user nova-compute[74319]: iface.chap_auth = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.bidi_chap = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.strict_login_compliance = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.discovery_auth = <empty>
Oct 30 14:15:14 user nova-compute[74319]: iface.discovery_logout = <empty>
Oct 30 14:15:14 user nova-compute[74319]: node.discovery_address = <empty>
Oct 30 14:15:14 user nova-compute[74319]: node.discovery_port = 0
Oct 30 14:15:14 user nova-compute[74319]: node.discovery_type = static
Oct 30 14:15:14 user nova-compute[74319]: node.session.initial_cmdsn = 0
Oct 30 14:15:14 user nova-compute[74319]: node.session.initial_login_retry_max = 8
Oct 30 14:15:14 user nova-compute[74319]: node.session.xmit_thread_priority = -20
Oct 30 14:15:14 user nova-compute[74319]: node.session.cmds_max = 128
Oct 30 14:15:14 user nova-compute[74319]: node.session.queue_depth = 32
Oct 30 14:15:14 user nova-compute[74319]: node.session.nr_sessions = 1
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.authmethod = CHAP
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.username = idBqLVkx
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.password = ***
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.username_in = <empty>
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.password_in = <empty>
Oct 30 14:15:14 user nova-compute[74319]: node.session.auth.chap_algs = MD5
Oct 30 14:15:14 user nova-compute[74319]: node.session.timeo.replacement_timeout = 120
Oct 30 14:15:14 user nova-compute[74319]: node.session.err_timeo.abort_timeout = 15
Oct 30 14:15:14 user nova-compute[74319]: node.session.err_timeo.lu_reset_timeout = 30
Oct 30 14:15:14 user nova-compute[74319]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 30 14:15:14 user nova-compute[74319]: node.session.err_timeo.host_reset_timeout = 60
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.FastAbort = Yes
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.InitialR2T = No
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.ImmediateData = Yes
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.FirstBurstLength = 262144
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.MaxBurstLength = 16776192
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.DefaultTime2Retain = 0
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.DefaultTime2Wait = 2
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.MaxConnections = 1
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 30 14:15:14 user nova-compute[74319]: node.session.iscsi.ERL = 0
Oct 30 14:15:14 user nova-compute[74319]: node.session.scan = manual
Oct 30 14:15:14 user nova-compute[74319]: node.session.reopen_max = 0
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].address = 172.16.0.220
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].port = 3260
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].startup = manual
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].tcp.window_size = 524288
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].tcp.type_of_service = 0
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].timeo.logout_timeout = 15
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].timeo.login_timeout = 15
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].timeo.auth_timeout = 45
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].timeo.noop_out_interval = 5
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].timeo.noop_out_timeout = 5
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.HeaderDigest = None
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.DataDigest = None
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.IFMarker = No
Oct 30 14:15:14 user nova-compute[74319]: node.conn[0].iscsi.OFMarker = No
Oct 30 14:15:14 user nova-compute[74319]: # END RECORD
Oct 30 14:15:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58c1ed0-8df3-407e-9b5f-bf85f455a3f3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eab29b8-f9f5-4cf3-ad2e-75845fb4d1eb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idBqLVkx {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v idBqLVkx" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff144e50-54e7-46fe-9749-2c9ca3de4aa1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'idBqLVkx'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5846d1-4371-4797-8432-9f7f0367ecba]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b84e22-c56f-4c7c-af00-32db634edf51]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:15:14 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.151s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] HCTL ('35', '0', '0', 0) found on session 33 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a203f8-5261-4020-8d58-3703908110d0]: (4, ('0 0 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Searching for a device in session 33 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23663636265323337', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663636265323337', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1463439560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1463439560',id=32,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:13:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ksogu7dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:13:48Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=5820195e-e4d1-44a4-86d8-25f003fca44a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:2c:39:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "vif_mac": "fa:16:3e:2c:39:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'pci_devices' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.objects.base [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Object Instance<5820195e-e4d1-44a4-86d8-25f003fca44a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:15:14 user nova-compute[74319]:   <uuid>5820195e-e4d1-44a4-86d8-25f003fca44a</uuid>
Oct 30 14:15:14 user nova-compute[74319]:   <name>instance-00000020</name>
Oct 30 14:15:14 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:15:14 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:15:14 user nova-compute[74319]:   <metadata>
Oct 30 14:15:14 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:15:14 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1463439560</nova:name>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:15:14</nova:creationTime>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:15:14 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:15:14 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:owner>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:user uuid="a708010243464fe9bbf96c2e0e79a0dd">tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member</nova:user>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:project uuid="40f2668e6b874840ad286ca9a8189fd4">tempest-ServerBootFromVolumeStableRescueTest-572655155</nova:project>
Oct 30 14:15:14 user nova-compute[74319]:       </nova:owner>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:15:14 user nova-compute[74319]:       <nova:ports>
Oct 30 14:15:14 user nova-compute[74319]:         <nova:port uuid="bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8">
Oct 30 14:15:14 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 14:15:14 user nova-compute[74319]:         </nova:port>
Oct 30 14:15:14 user nova-compute[74319]:       </nova:ports>
Oct 30 14:15:14 user nova-compute[74319]:     </nova:instance>
Oct 30 14:15:14 user nova-compute[74319]:   </metadata>
Oct 30 14:15:14 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:15:14 user nova-compute[74319]:     <system>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="serial">5820195e-e4d1-44a4-86d8-25f003fca44a</entry>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="uuid">5820195e-e4d1-44a4-86d8-25f003fca44a</entry>
Oct 30 14:15:14 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:15:14 user nova-compute[74319]:     </system>
Oct 30 14:15:14 user nova-compute[74319]:   </sysinfo>
Oct 30 14:15:14 user nova-compute[74319]:   <os>
Oct 30 14:15:14 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:15:14 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:15:14 user nova-compute[74319]:   </os>
Oct 30 14:15:14 user nova-compute[74319]:   <features>
Oct 30 14:15:14 user nova-compute[74319]:     <acpi/>
Oct 30 14:15:14 user nova-compute[74319]:     <apic/>
Oct 30 14:15:14 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:15:14 user nova-compute[74319]:   </features>
Oct 30 14:15:14 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:15:14 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:15:14 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:15:14 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:15:14 user nova-compute[74319]:   </clock>
Oct 30 14:15:14 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:15:14 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:15:14 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:15:14 user nova-compute[74319]:   </cpu>
Oct 30 14:15:14 user nova-compute[74319]:   <devices>
Oct 30 14:15:14 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:15:14 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:15:14 user nova-compute[74319]:       <source dev="/dev/sdd"/>
Oct 30 14:15:14 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:15:14 user nova-compute[74319]:       <serial>ace075d9-7d66-4eda-a20b-def23d6c2ec0</serial>
Oct 30 14:15:14 user nova-compute[74319]:     </disk>
Oct 30 14:15:14 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:15:14 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:15:14 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue"/>
Oct 30 14:15:14 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:15:14 user nova-compute[74319]:       <boot order="1"/>
Oct 30 14:15:14 user nova-compute[74319]:     </disk>
Oct 30 14:15:14 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:15:14 user nova-compute[74319]:       <mac address="fa:16:3e:2c:39:7f"/>
Oct 30 14:15:14 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:15:14 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:15:14 user nova-compute[74319]:       <target dev="tapbad6e3d1-e7"/>
Oct 30 14:15:14 user nova-compute[74319]:     </interface>
Oct 30 14:15:14 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:15:14 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/console.log" append="off"/>
Oct 30 14:15:14 user nova-compute[74319]:     </serial>
Oct 30 14:15:14 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:15:14 user nova-compute[74319]:     <video>
Oct 30 14:15:14 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:15:14 user nova-compute[74319]:     </video>
Oct 30 14:15:14 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:15:14 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:15:14 user nova-compute[74319]:     </rng>
Oct 30 14:15:14 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:15:14 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:15:14 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:15:14 user nova-compute[74319]:     </memballoon>
Oct 30 14:15:14 user nova-compute[74319]:   </devices>
Oct 30 14:15:14 user nova-compute[74319]: </domain>
Oct 30 14:15:14 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:15:14 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance destroyed successfully.
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:15:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] No VIF found with MAC fa:16:3e:2c:39:7f, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:15 user nova-compute[74319]: WARNING nova.compute.manager [req-0941794b-6498-48c8-9c16-096c0bb10799 req-22584095-31ed-47ab-8ea9-85a04bf102fe service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state active and task_state rescuing.
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-327efd41-b789-4da8-bc12-7055a7f6fa0e tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:17 user nova-compute[74319]: WARNING nova.compute.manager [req-71a4cec5-2988-48d4-b372-44dbe1925e74 req-e57b08f9-d8fd-4ee3-b54d-4be9365c3b98 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state active and task_state rescuing.
Oct 30 14:15:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing instance network info cache due to event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updated VIF entry in instance network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e2ca24b-9cb0-46ea-bc1c-857d5bad5bd7 req-f2fdd0d2-46cc-4fcb-9867-6840bed97be9 service nova] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:20 user nova-compute[74319]: INFO nova.compute.manager [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Shelve offloading
Oct 30 14:15:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance destroyed successfully.
Oct 30 14:15:21 user nova-compute[74319]: DEBUG nova.compute.manager [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:15:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:15:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:15:21 user nova-compute[74319]: DEBUG nova.network.neutron [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.network.neutron [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:22 user nova-compute[74319]: WARNING nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state shelving.
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:22 user nova-compute[74319]: WARNING nova.compute.manager [req-de1974b0-d4e9-4b34-b3ca-9e3e36a10079 req-8c1a2815-33bd-408b-a40b-186e86c460db service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state shelving.
Oct 30 14:15:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance destroyed successfully.
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'resources' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdP9qy65aGRzPvBVvvYInx9XgQMNetAWvJWaPPJbeVYG7pja9CsUPMH2bOIPmjS+VJNiMC4Z6ynLByOxDS9HLrMlyaZQNIEJTdw2nNIr2Oq2vqN1M9cy77Ox4vwv+Ivqw==',key_name='tempest-TestShelveInstance-77344443',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:13:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:13:56Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_vif [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f366e93-d4, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e211a8c6-81a7-4e84-93f0-e141f4ac203d) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:15:22 user nova-compute[74319]: INFO os_vif [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4')
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:15:22 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e3434f-5680-4acd-949a-9b72482d8051]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:15:22 user nova-compute[74319]: No targets found.
Oct 30 14:15:22 user nova-compute[74319]: iSNS:
Oct 30 14:15:22 user nova-compute[74319]: No targets found.
Oct 30 14:15:22 user nova-compute[74319]: STATIC:
Oct 30 14:15:22 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:15:22 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:15:22 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:15:22 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:15:22 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:15:22 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:15:22 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:15:22 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:15:22 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:15:22 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:15:22 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:15:22 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:15:22 user nova-compute[74319]: FIRMWARE:
Oct 30 14:15:22 user nova-compute[74319]: No targets found.
Oct 30 14:15:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:15:22 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:15:22 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing instance network info cache due to event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4b6174-8f3b-4796-bec2-80a156d852cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbbf67e-468c-421f-bc6b-f5fea158b995]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:15:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998674a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572'): ({'sdf'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Removing single pathed devices sdf {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[72826f53-b738-46f4-a999-2ca601e05d7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[253558d8-5a8e-4dab-a4ea-f3fdee696dfb]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flushing IO for device /dev/sdf {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[356bfab0-bd91-4686-a613-88c3744cfb15]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6528f6db-39ab-4a58-8487-005fbad42811]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:15:22 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9bd9c0-9b5e-4a14-861b-05281b2f3fb4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6158d2-4028-451a-9354-d65e861ac2f0]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]
Oct 30 14:15:23 user nova-compute[74319]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.
Oct 30 14:15:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[703b87a3-6f63-4404-a921-1c81d9be360b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== disconnect_volume: return (345ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:15:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deleting instance files /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa_del
Oct 30 14:15:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deletion of /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa_del complete
Oct 30 14:15:23 user nova-compute[74319]: DEBUG nova.network.neutron [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updated VIF entry in instance network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG nova.network.neutron [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": null, "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8f366e93-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f7836cb6-dfc9-4864-ae2d-0e2e780dbbb7 req-140e4f6f-213b-4877-bac4-b995c278a298 service nova] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:15:24 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Deleted allocations for instance 5048109c-d671-4953-b819-fdb69e3052fa
Oct 30 14:15:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'numa_topology' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG nova.objects.base [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Object Instance<5048109c-d671-4953-b819-fdb69e3052fa> lazy-loaded attributes: resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b0e75020-5f5f-469f-9c1b-392976e50fe9 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.964s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:31 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:15:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:15:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:15:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=24.999996185302734GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Applying migration context for instance 78691de8-10df-403c-91d2-afc7594a413d as it has an incoming, in-progress migration c28be1e6-75f1-4f31-8884-100f3498b929. Migration status is finished {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 30 14:15:35 user nova-compute[74319]: INFO nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating resource usage from migration c28be1e6-75f1-4f31-8884-100f3498b929
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 43fe7c9d-5a25-455b-8245-6028034d44a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85d79bce-38a7-4708-ae18-22467ad15886 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Migration c28be1e6-75f1-4f31-8884-100f3498b929 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance acbcf291-490e-454c-bed2-197e923d657e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:15:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:15:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:38 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:15:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [{"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-3fb6cc13-e069-46bc-9b0b-50fe57103fd5" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:15:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:15:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:15:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:50 user nova-compute[74319]: INFO nova.compute.manager [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Terminating instance
Oct 30 14:15:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-a0b15349-b41a-4626-a126-9b7cb2fbb4a9 req-06b9ef3d-9d0e-43d3-adf8-9fa7c647b401 service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-unplugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:15:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Instance destroyed successfully.
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.objects.instance [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'resources' on Instance uuid 43fe7c9d-5a25-455b-8245-6028034d44a9 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:05:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-447137083',display_name='tempest-AttachVolumeTestJSON-server-447137083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-447137083',id=25,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIAE3YKO1ScXjDsu8ZuIhxsS5doiWwyCcYfgTDw487Lbc+MdXUVXVnARH6sggsQeKuMwlPu9yJniChWtf7hNy5RSjpOCZYtMpzpa3AKYuuQaaw8O7e45hIa6uSxc/cil0A==',key_name='tempest-keypair-1941703687',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-yy1q7m8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:14:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=43fe7c9d-5a25-455b-8245-6028034d44a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "c83bbef5-d67d-4021-8153-e35b9019544e", "address": "fa:16:3e:1e:90:5f", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc83bbef5-d6", "ovs_interfaceid": "c83bbef5-d67d-4021-8153-e35b9019544e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG os_vif [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc83bbef5-d6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9092c7a7-242a-40c3-9ea6-86eee3f48d9b) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:15:51 user nova-compute[74319]: INFO os_vif [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:90:5f,bridge_name='br-int',has_traffic_filtering=True,id=c83bbef5-d67d-4021-8153-e35b9019544e,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc83bbef5-d6')
Oct 30 14:15:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Deleting instance files /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9_del
Oct 30 14:15:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Deletion of /opt/stack/data/nova/instances/43fe7c9d-5a25-455b-8245-6028034d44a9_del complete
Oct 30 14:15:51 user nova-compute[74319]: INFO nova.compute.manager [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 30 14:15:51 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:15:51 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:15:52 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:15:52 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Took 0.69 seconds to deallocate network for instance.
Oct 30 14:15:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:52 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:15:52 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:15:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:52 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Deleted allocations for instance 43fe7c9d-5a25-455b-8245-6028034d44a9
Oct 30 14:15:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-84c85974-d9c4-4fa7-b017-7c45e50766b2 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.101s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] Acquiring lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:15:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:15:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] Lock "43fe7c9d-5a25-455b-8245-6028034d44a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:15:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] No waiting events found dispatching network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:15:53 user nova-compute[74319]: WARNING nova.compute.manager [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received unexpected event network-vif-plugged-c83bbef5-d67d-4021-8153-e35b9019544e for instance with vm_state deleted and task_state None.
Oct 30 14:15:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-829fc822-f5f5-469b-92db-436c980df45b req-25bb3222-1a61-49d4-a082-a7ea9165eb1a service nova] [instance: 43fe7c9d-5a25-455b-8245-6028034d44a9] Received event network-vif-deleted-c83bbef5-d67d-4021-8153-e35b9019544e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:15:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:15:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-changed-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Refreshing instance network info cache due to event network-changed-3a745c2c-4c94-49d3-a7e3-44efaa673040. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] Acquiring lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] Acquired lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.network.neutron [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Refreshing network info cache for port 3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.network.neutron [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updated VIF entry in instance network info cache for port 3a745c2c-4c94-49d3-a7e3-44efaa673040. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG nova.network.neutron [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updating instance_info_cache with network_info: [{"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Ignoring supplied device name: /dev/vdb
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-143fc621-d8d4-407e-a8f5-11e0da83973b req-15088c40-9e06-48c3-a099-22cc65807f20 service nova] Releasing lock "refresh_cache-85d79bce-38a7-4708-ae18-22467ad15886" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:16:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:01 user nova-compute[74319]: INFO nova.compute.manager [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Attaching volume c0049d32-a818-4288-99a3-b9ba615edc15 to /dev/vdb
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b5e07f-0b07-4e9a-9071-95eeb3ab9a10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[149da433-a360-4cce-9d1d-a73d570fd768]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd61247-ecde-4a10-b27a-fa353aecae24]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c652f2-f105-451d-a24a-1b56ce7c4d94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:16:01 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:16:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06daac6-e31e-4a2d-98e3-deea78ddb489]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updating existing volume attachment record: 8dfdd828-0b09-4a10-8870-16c22b51e705 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:16:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Going to confirm migration 1 {{(pid=74319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'info_cache' on Instance uuid 78691de8-10df-403c-91d2-afc7594a413d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.network.neutron [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'migration_context' on Instance uuid 78691de8-10df-403c-91d2-afc7594a413d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG nova.objects.base [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Object Instance<78691de8-10df-403c-91d2-afc7594a413d> lazy-loaded attributes: info_cache,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:09 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:16:09 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:16:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.389s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:09 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Deleted allocation for migration c28be1e6-75f1-4f31-8884-100f3498b929
Oct 30 14:16:09 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0af6851a-0398-4878-8e6e-817e7a1b6824 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.408s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGPAFylQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:16:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:16:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:16:21 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab895d2d-ef93-41bc-b04f-42f718d55de7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:16:21 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15c10e8-e34d-4a7f-8723-b47c35480f97]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15] added
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99124c53-bdd5-40c7-bcc3-b78af4ee157e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a742c02-c43c-42f3-9d67-68f8138b435f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGPAFylQ {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IGPAFylQ" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d732dd-d114-4b89-a704-49addb5f9ae7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IGPAFylQ'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[741972ce-c265-4152-b087-b8c34df13fed]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[867fbb77-9fdb-4145-b350-a7d97ccbd783]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a35607-2455-4366-a386-f5d5017ef246]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260]
Oct 30 14:16:21 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260] successful.
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310c95a-bd58-48e8-8290-2d25e758deb8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5b3e21-9971-4eb8-a4b2-4c802f5ed642]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:16:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10b78c-cd37-4f23-aba5-ae337783b6b3]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:16:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGPAFylQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:16:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:16:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26563353634646566', 'path': '/dev/sde'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:16:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563353634646566', 'path': '/dev/sde'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:16:22 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:16:22 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:16:22 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:16:22 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:16:22 user nova-compute[74319]:   <serial>c0049d32-a818-4288-99a3-b9ba615edc15</serial>
Oct 30 14:16:22 user nova-compute[74319]: </disk>
Oct 30 14:16:22 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:16:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:16:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:16:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] No VIF found with MAC fa:16:3e:17:08:c0, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:16:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e34d0f8b-5a3a-47a9-9f63-08732b077e92 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.192s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:32 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:32 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:16:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:16:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=25.024078369140625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85d79bce-38a7-4708-ae18-22467ad15886 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance acbcf291-490e-454c-bed2-197e923d657e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:16:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:39 user nova-compute[74319]: INFO nova.compute.manager [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Terminating instance
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-b81dabaf-5b78-48fb-a345-7d4550b12149 req-54a22a6b-79ce-4d80-b54d-b8b75a063d41 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-unplugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:16:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Instance destroyed successfully.
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lazy-loading 'resources' on Instance uuid acbcf291-490e-454c-bed2-197e923d657e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:10:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1427360873',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1427360873',id=29,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMatiEjrg54c7ufpvCpKiN4N+7JgFt2H+65DC18ymT5sW2GL1SfP5+qZUO5niQ5l71gzOgdx5XEgvrJjBTO1u8NErc9qmP6xFqISZrllcnQB0umqah4auZaBqbCGR8wxtQ==',key_name='tempest-keypair-1424537780',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:15:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e173b99e7da54c6688ccc9969dbaa7f4',ramdisk_id='',reservation_id='r-0oxdxf3v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-282209841',owner_user_name='tempest-AttachVolumeShelveTestJSON-282209841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:15:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72f5d276e62a472b92e46d28aa5a5286',uuid=acbcf291-490e-454c-bed2-197e923d657e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converting VIF {"id": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "address": "fa:16:3e:52:e6:ec", "network": {"id": "5c72fb76-89b2-4950-8720-848ed0919a46", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-884182923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e173b99e7da54c6688ccc9969dbaa7f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7007b011-9b", "ovs_interfaceid": "7007b011-9b96-4a02-b69e-2e4b401fb2af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG os_vif [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7007b011-9b, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3063037-4f84-4db3-bff4-38a1877a4ad1) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:39 user nova-compute[74319]: INFO os_vif [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:e6:ec,bridge_name='br-int',has_traffic_filtering=True,id=7007b011-9b96-4a02-b69e-2e4b401fb2af,network=Network(5c72fb76-89b2-4950-8720-848ed0919a46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7007b011-9b')
Oct 30 14:16:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Deleting instance files /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e_del
Oct 30 14:16:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Deletion of /opt/stack/data/nova/instances/acbcf291-490e-454c-bed2-197e923d657e_del complete
Oct 30 14:16:39 user nova-compute[74319]: INFO nova.compute.manager [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] [instance: acbcf291-490e-454c-bed2-197e923d657e] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 30 14:16:39 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:16:39 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:40 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: acbcf291-490e-454c-bed2-197e923d657e] Took 0.64 seconds to deallocate network for instance.
Oct 30 14:16:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:40 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Deleted allocations for instance acbcf291-490e-454c-bed2-197e923d657e
Oct 30 14:16:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-aef20fb7-4c59-4d45-ac4e-d52f88743d21 tempest-AttachVolumeShelveTestJSON-282209841 tempest-AttachVolumeShelveTestJSON-282209841-project-member] Lock "acbcf291-490e-454c-bed2-197e923d657e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.831s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] Acquiring lock "acbcf291-490e-454c-bed2-197e923d657e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] Lock "acbcf291-490e-454c-bed2-197e923d657e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] No waiting events found dispatching network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:16:41 user nova-compute[74319]: WARNING nova.compute.manager [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received unexpected event network-vif-plugged-7007b011-9b96-4a02-b69e-2e4b401fb2af for instance with vm_state deleted and task_state None.
Oct 30 14:16:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-690ab6d9-9481-4f9f-8fab-b602862dbbcb req-90f95378-792d-48d8-a016-112a5fd08d47 service nova] [instance: acbcf291-490e-454c-bed2-197e923d657e] Received event network-vif-deleted-7007b011-9b96-4a02-b69e-2e4b401fb2af {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updating instance_info_cache with network_info: [{"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-6c5db4aa-4158-4870-8465-bf738b5e1b30" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:16:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:16:44 user nova-compute[74319]: INFO nova.compute.claims [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Claim successful on node user
Oct 30 14:16:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:16:44 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:16:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.policy [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '521f59eb12f844b49a6a727ec38bd016', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42370e22b20540a6b4670bfcc02d62b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:16:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Creating image(s)
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "/opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "/opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "/opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Successfully created port: 4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:16:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Cannot resize image /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Ensure instance console log exists: /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Successfully updated port: 4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquired lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-changed-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Refreshing instance network info cache due to event network-changed-4fe89742-4979-4ec5-acc1-9b926bb88cb9. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] Acquiring lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating instance_info_cache with network_info: [{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Releasing lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Instance network_info: |[{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] Acquired lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.network.neutron [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Refreshing network info cache for port 4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Start _get_guest_xml network_info=[{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:16:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:16:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:16:46 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879111475',display_name='tempest-AttachVolumeTestJSON-server-1879111475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879111475',id=35,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDx27VfNFLMf0o7OBVOQnK2oWewL2tH+dLxKEnA3ipqP282olGvdXIPYLnZRgkFTs/mHWYnWT0xHVlxYDFXLMGwWycpk/f78kd+e9DWNOrdyT7ULeXAzCoUGdhyw4pb/Q==',key_name='tempest-keypair-534718999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-ncp4oqbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=415ca70b-eb7b-484d-925e-14fbd8980d7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'pci_devices' on Instance uuid 415ca70b-eb7b-484d-925e-14fbd8980d7a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:16:47 user nova-compute[74319]:   <uuid>415ca70b-eb7b-484d-925e-14fbd8980d7a</uuid>
Oct 30 14:16:47 user nova-compute[74319]:   <name>instance-00000023</name>
Oct 30 14:16:47 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:16:47 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:16:47 user nova-compute[74319]:   <metadata>
Oct 30 14:16:47 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:16:47 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1879111475</nova:name>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:16:46</nova:creationTime>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:16:47 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:16:47 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:owner>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:user uuid="521f59eb12f844b49a6a727ec38bd016">tempest-AttachVolumeTestJSON-636845633-project-member</nova:user>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:project uuid="42370e22b20540a6b4670bfcc02d62b6">tempest-AttachVolumeTestJSON-636845633</nova:project>
Oct 30 14:16:47 user nova-compute[74319]:       </nova:owner>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:16:47 user nova-compute[74319]:       <nova:ports>
Oct 30 14:16:47 user nova-compute[74319]:         <nova:port uuid="4fe89742-4979-4ec5-acc1-9b926bb88cb9">
Oct 30 14:16:47 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:16:47 user nova-compute[74319]:         </nova:port>
Oct 30 14:16:47 user nova-compute[74319]:       </nova:ports>
Oct 30 14:16:47 user nova-compute[74319]:     </nova:instance>
Oct 30 14:16:47 user nova-compute[74319]:   </metadata>
Oct 30 14:16:47 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:16:47 user nova-compute[74319]:     <system>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="serial">415ca70b-eb7b-484d-925e-14fbd8980d7a</entry>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="uuid">415ca70b-eb7b-484d-925e-14fbd8980d7a</entry>
Oct 30 14:16:47 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:16:47 user nova-compute[74319]:     </system>
Oct 30 14:16:47 user nova-compute[74319]:   </sysinfo>
Oct 30 14:16:47 user nova-compute[74319]:   <os>
Oct 30 14:16:47 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:16:47 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:16:47 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:16:47 user nova-compute[74319]:   </os>
Oct 30 14:16:47 user nova-compute[74319]:   <features>
Oct 30 14:16:47 user nova-compute[74319]:     <acpi/>
Oct 30 14:16:47 user nova-compute[74319]:     <apic/>
Oct 30 14:16:47 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:16:47 user nova-compute[74319]:   </features>
Oct 30 14:16:47 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:16:47 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:16:47 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:16:47 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:16:47 user nova-compute[74319]:   </clock>
Oct 30 14:16:47 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:16:47 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:16:47 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:16:47 user nova-compute[74319]:   </cpu>
Oct 30 14:16:47 user nova-compute[74319]:   <devices>
Oct 30 14:16:47 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:16:47 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:16:47 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk"/>
Oct 30 14:16:47 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:16:47 user nova-compute[74319]:     </disk>
Oct 30 14:16:47 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:16:47 user nova-compute[74319]:       <mac address="fa:16:3e:3c:fc:92"/>
Oct 30 14:16:47 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:16:47 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:16:47 user nova-compute[74319]:       <target dev="tap4fe89742-49"/>
Oct 30 14:16:47 user nova-compute[74319]:     </interface>
Oct 30 14:16:47 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:16:47 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/console.log" append="off"/>
Oct 30 14:16:47 user nova-compute[74319]:     </serial>
Oct 30 14:16:47 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:16:47 user nova-compute[74319]:     <video>
Oct 30 14:16:47 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:16:47 user nova-compute[74319]:     </video>
Oct 30 14:16:47 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:16:47 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:16:47 user nova-compute[74319]:     </rng>
Oct 30 14:16:47 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:16:47 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:16:47 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:16:47 user nova-compute[74319]:     </memballoon>
Oct 30 14:16:47 user nova-compute[74319]:   </devices>
Oct 30 14:16:47 user nova-compute[74319]: </domain>
Oct 30 14:16:47 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879111475',display_name='tempest-AttachVolumeTestJSON-server-1879111475',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879111475',id=35,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDx27VfNFLMf0o7OBVOQnK2oWewL2tH+dLxKEnA3ipqP282olGvdXIPYLnZRgkFTs/mHWYnWT0xHVlxYDFXLMGwWycpk/f78kd+e9DWNOrdyT7ULeXAzCoUGdhyw4pb/Q==',key_name='tempest-keypair-534718999',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-ncp4oqbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=415ca70b-eb7b-484d-925e-14fbd8980d7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG os_vif [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da2a824e-2897-5187-90ee-1d588364378b', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fe89742-49, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fe89742-49, col_values=(('qos', UUID('1d84b15c-306b-426b-8bf4-9a2b6ad701e7')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fe89742-49, col_values=(('external_ids', {'iface-id': '4fe89742-4979-4ec5-acc1-9b926bb88cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:fc:92', 'vm-uuid': '415ca70b-eb7b-484d-925e-14fbd8980d7a'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:47 user nova-compute[74319]: INFO os_vif [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49')
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] No VIF found with MAC fa:16:3e:3c:fc:92, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.neutron [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updated VIF entry in instance network info cache for port 4fe89742-4979-4ec5-acc1-9b926bb88cb9. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG nova.network.neutron [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating instance_info_cache with network_info: [{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:16:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-065bc7dd-833a-4968-9939-d99e228bcf43 req-ffbc2924-00f2-4013-b620-ca719c2d2673 service nova] Releasing lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] No waiting events found dispatching network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:16:48 user nova-compute[74319]: WARNING nova.compute.manager [req-4d58c95d-f3e8-4995-8869-8c09d09dbb0e req-cd25e65d-ba5a-44df-954a-f37f0a9112b2 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received unexpected event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 for instance with vm_state building and task_state spawning.
Oct 30 14:16:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:16:50 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Instance spawned successfully.
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] No waiting events found dispatching network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:16:50 user nova-compute[74319]: WARNING nova.compute.manager [req-8f03bb63-7fe6-41eb-aa56-b3d00b5a11cb req-8933e833-4830-464f-837a-24f42f7a84db service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received unexpected event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 for instance with vm_state building and task_state spawning.
Oct 30 14:16:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:50 user nova-compute[74319]: INFO nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Took 5.52 seconds to spawn the instance on the hypervisor.
Oct 30 14:16:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:16:50 user nova-compute[74319]: INFO nova.compute.manager [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Took 6.32 seconds to build instance.
Oct 30 14:16:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-23396722-28fb-4ebb-9b9e-0c6dbb077101 tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.414s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:16:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:16:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:01 user nova-compute[74319]: INFO nova.compute.manager [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Unrescuing
Oct 30 14:17:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:17:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquired lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:17:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:17:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating instance_info_cache with network_info: [{"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:17:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Releasing lock "refresh_cache-5820195e-e4d1-44a4-86d8-25f003fca44a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:17:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'flavor' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:02 user nova-compute[74319]: WARNING nova.compute.manager [req-ffe420ef-47e4-4261-84f9-185d2d166605 req-a81ef896-82c4-4ba7-8302-47c4a8aa5239 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:17:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance destroyed successfully.
Oct 30 14:17:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:04 user nova-compute[74319]: WARNING nova.compute.manager [req-c8e567f9-459b-40aa-bd1a-7c31ee0d926e req-f156cb64-b180-4382-ae7a-37dedc8b2e32 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:17:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c7079449-6cff-46ed-8011-69ce05485306 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:06 user nova-compute[74319]: WARNING nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:17:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:06 user nova-compute[74319]: WARNING nova.compute.manager [req-8c434452-3d36-451e-86da-0e71e3ac1fc8 req-6db6a01f-8353-48dc-b420-b44d5c642eb1 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:17:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:12 user nova-compute[74319]: INFO nova.compute.manager [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Unshelving
Oct 30 14:17:12 user nova-compute[74319]: INFO nova.virt.block_device [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Booting with volume 70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 at /dev/vda
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.utils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e6a33-3288-46ab-a0e9-e9a2566e7ab7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8b2ba-a6e3-4c5c-9a78-d3500d0f7947]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca1b74-31cb-49c9-a0a9-8ba85084cbdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fddd82-8322-4b73-bb1f-5414129125f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:17:12 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:17:12 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3059a7fb-630f-4548-8654-5a67b9ff6918]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG os_brick.utils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:17:12 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating existing volume attachment record: 63ccd3b9-f22a-41ce-95cc-a851ad0216ec {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:17:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:17 user nova-compute[74319]: INFO nova.compute.manager [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Detaching volume c0049d32-a818-4288-99a3-b9ba615edc15
Oct 30 14:17:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:17 user nova-compute[74319]: INFO nova.virt.block_device [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Attempting to driver detach volume c0049d32-a818-4288-99a3-b9ba615edc15 from mountpoint /dev/vdb
Oct 30 14:17:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Attempting to detach device vdb from instance 85d79bce-38a7-4708-ae18-22467ad15886 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:17:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:17:17 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:17:17 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:17:17 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:17:17 user nova-compute[74319]:   <serial>c0049d32-a818-4288-99a3-b9ba615edc15</serial>
Oct 30 14:17:17 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:17:17 user nova-compute[74319]: </disk>
Oct 30 14:17:17 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:17:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully detached device vdb from instance 85d79bce-38a7-4708-ae18-22467ad15886 from the persistent domain config.
Oct 30 14:17:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85d79bce-38a7-4708-ae18-22467ad15886 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:17:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:17:17 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:17:17 user nova-compute[74319]:   <source dev="/dev/sde"/>
Oct 30 14:17:17 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:17:17 user nova-compute[74319]:   <serial>c0049d32-a818-4288-99a3-b9ba615edc15</serial>
Oct 30 14:17:17 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:17:17 user nova-compute[74319]: </disk>
Oct 30 14:17:17 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:17:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:17:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG nova.objects.instance [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'pci_requests' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG nova.objects.instance [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'numa_topology' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:32 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:17:32 user nova-compute[74319]: INFO nova.compute.claims [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Claim successful on node user
Oct 30 14:17:33 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:17:33 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:17:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.431s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:33 user nova-compute[74319]: INFO nova.network.neutron [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating port 8f366e93-d46f-45a4-935c-f9b8ac07b031 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 30 14:17:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:17:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:17:33 user nova-compute[74319]: DEBUG nova.network.neutron [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing instance network info cache due to event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:17:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Creating image(s)
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Ensure instance console log exists: /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start _get_guest_xml network_info=[{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '63ccd3b9-f22a-41ce-95cc-a851ad0216ec', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5048109c-d671-4953-b819-fdb69e3052fa', 'attached_at': '', 'detached_at': '', 'volume_id': '70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'serial': '70ec54b9-c9c6-4fd6-8ef0-ac08dedde572'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:17:34 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:17:34 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.objects.instance [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.objects.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Object Instance<5048109c-d671-4953-b819-fdb69e3052fa> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:17:34 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:17:34 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:17:34 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d7961-8811-4e2c-b519-39c005763a48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:17:34 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10729f-6178-4fd2-8904-1bbd2321757c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572] added
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24b783c-2e2e-4012-b6bf-5b6f28fc2862]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de84620-cb8a-4365-bb23-e4b0aed62dfb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbUCryHu {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BbUCryHu" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5287e0ef-dbfd-49b3-9c5c-8f5f435f5991]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BbUCryHu'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e7583-9346-4f49-82d3-cb612f500e8d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e371ca-9122-4f5a-ab98-606fccadd76a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[44881f81-1d7e-4aab-a139-a1761288b696]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]
Oct 30 14:17:34 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d8973-524a-4f46-849e-7a7e55c9681d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb787813-20f7-41ac-8f53-09509263a7a5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updated VIF entry in instance network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6c57f-97ec-4805-9637-86db7275e1bf]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3130975c-50b7-4447-801e-c30fb3b9ba74 req-93d49dd4-d416-43b1-8c40-5d5ca7ddfd01 service nova] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:34 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23262613931333437', 'path': '/dev/sdf'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262613931333437', 'path': '/dev/sdf'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-77344443',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:13:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:17:13Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.objects.instance [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'pci_devices' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.objects.base [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Object Instance<5048109c-d671-4953-b819-fdb69e3052fa> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:17:35 user nova-compute[74319]:   <uuid>5048109c-d671-4953-b819-fdb69e3052fa</uuid>
Oct 30 14:17:35 user nova-compute[74319]:   <name>instance-00000021</name>
Oct 30 14:17:35 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:17:35 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:17:35 user nova-compute[74319]:   <metadata>
Oct 30 14:17:35 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:17:35 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:17:35 user nova-compute[74319]:       <nova:name>tempest-TestShelveInstance-server-1149684489</nova:name>
Oct 30 14:17:35 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:17:34</nova:creationTime>
Oct 30 14:17:35 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:17:35 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:17:35 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:17:35 user nova-compute[74319]:       <nova:owner>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:user uuid="e1384ea11d244bb3b5bbd47634caef19">tempest-TestShelveInstance-676790378-project-member</nova:user>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:project uuid="46c403cd3f6549a3b44268ae4f36fa9b">tempest-TestShelveInstance-676790378</nova:project>
Oct 30 14:17:35 user nova-compute[74319]:       </nova:owner>
Oct 30 14:17:35 user nova-compute[74319]:       <nova:ports>
Oct 30 14:17:35 user nova-compute[74319]:         <nova:port uuid="8f366e93-d46f-45a4-935c-f9b8ac07b031">
Oct 30 14:17:35 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:17:35 user nova-compute[74319]:         </nova:port>
Oct 30 14:17:35 user nova-compute[74319]:       </nova:ports>
Oct 30 14:17:35 user nova-compute[74319]:     </nova:instance>
Oct 30 14:17:35 user nova-compute[74319]:   </metadata>
Oct 30 14:17:35 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:17:35 user nova-compute[74319]:     <system>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="serial">5048109c-d671-4953-b819-fdb69e3052fa</entry>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="uuid">5048109c-d671-4953-b819-fdb69e3052fa</entry>
Oct 30 14:17:35 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:17:35 user nova-compute[74319]:     </system>
Oct 30 14:17:35 user nova-compute[74319]:   </sysinfo>
Oct 30 14:17:35 user nova-compute[74319]:   <os>
Oct 30 14:17:35 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:17:35 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:17:35 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:17:35 user nova-compute[74319]:   </os>
Oct 30 14:17:35 user nova-compute[74319]:   <features>
Oct 30 14:17:35 user nova-compute[74319]:     <acpi/>
Oct 30 14:17:35 user nova-compute[74319]:     <apic/>
Oct 30 14:17:35 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:17:35 user nova-compute[74319]:   </features>
Oct 30 14:17:35 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:17:35 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:17:35 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:17:35 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:17:35 user nova-compute[74319]:   </clock>
Oct 30 14:17:35 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:17:35 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:17:35 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:17:35 user nova-compute[74319]:   </cpu>
Oct 30 14:17:35 user nova-compute[74319]:   <devices>
Oct 30 14:17:35 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:17:35 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:17:35 user nova-compute[74319]:       <source dev="/dev/sdf"/>
Oct 30 14:17:35 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:17:35 user nova-compute[74319]:       <serial>70ec54b9-c9c6-4fd6-8ef0-ac08dedde572</serial>
Oct 30 14:17:35 user nova-compute[74319]:     </disk>
Oct 30 14:17:35 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:17:35 user nova-compute[74319]:       <mac address="fa:16:3e:89:13:6d"/>
Oct 30 14:17:35 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:17:35 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:17:35 user nova-compute[74319]:       <target dev="tap8f366e93-d4"/>
Oct 30 14:17:35 user nova-compute[74319]:     </interface>
Oct 30 14:17:35 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:17:35 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa/console.log" append="off"/>
Oct 30 14:17:35 user nova-compute[74319]:     </serial>
Oct 30 14:17:35 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:17:35 user nova-compute[74319]:     <video>
Oct 30 14:17:35 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:17:35 user nova-compute[74319]:     </video>
Oct 30 14:17:35 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:17:35 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:17:35 user nova-compute[74319]:     </rng>
Oct 30 14:17:35 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:17:35 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:17:35 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:17:35 user nova-compute[74319]:     </memballoon>
Oct 30 14:17:35 user nova-compute[74319]:   </devices>
Oct 30 14:17:35 user nova-compute[74319]: </domain>
Oct 30 14:17:35 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-77344443',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:13:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:17:13Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG os_vif [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c99b445b-1062-555d-aa94-e7ee6f2faacb', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f366e93-d4, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f366e93-d4, col_values=(('qos', UUID('f40aee51-413c-4bc3-a2f1-7df0fd7d728b')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f366e93-d4, col_values=(('external_ids', {'iface-id': '8f366e93-d46f-45a4-935c-f9b8ac07b031', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:13:6d', 'vm-uuid': '5048109c-d671-4953-b819-fdb69e3052fa'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:35 user nova-compute[74319]: INFO os_vif [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4')
Oct 30 14:17:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] No VIF found with MAC fa:16:3e:89:13:6d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:39 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85d79bce-38a7-4708-ae18-22467ad15886 is timed out.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:39 user nova-compute[74319]: WARNING nova.compute.manager [req-581b4ce2-6907-472f-9436-1dbec381ccff req-c045d708-86cb-4b86-970c-225aebf7515d service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:39 user nova-compute[74319]: WARNING nova.compute.manager [req-85896d1c-49bb-4ad9-8ad5-a10d15779870 req-08dd08b3-0b01-4f62-a5bf-35d0fe799f77 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:17:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully detached device vdb from instance 85d79bce-38a7-4708-ae18-22467ad15886 from the live domain config.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGPAFylQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:17:39 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:17:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance spawned successfully.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:17:39 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:17:39 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=7990MB free_disk=25.021446228027344GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a76c428-1ff8-4b21-bffc-3e9a7cf7831d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:17:39 user nova-compute[74319]: No targets found.
Oct 30 14:17:39 user nova-compute[74319]: iSNS:
Oct 30 14:17:39 user nova-compute[74319]: No targets found.
Oct 30 14:17:39 user nova-compute[74319]: STATIC:
Oct 30 14:17:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:17:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:17:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:17:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:17:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:39 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15
Oct 30 14:17:39 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:39 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:39 user nova-compute[74319]: FIRMWARE:
Oct 30 14:17:39 user nova-compute[74319]: No targets found.
Oct 30 14:17:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:17:39 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:17:39 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9daf2cc-482a-4018-899a-a964e8c7f7b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-73ec993c-4d81-472e-8746-6346129a485a tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.133s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[53577b3a-f60d-46a4-8626-f8cb013fe1b3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974569090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15'): ({'sde'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Removing single pathed devices sde {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf8af9d-5b70-4150-bbb9-fb49e5b772f6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[887927be-10bd-42ac-8084-c46b65596e3c]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Flushing IO for device /dev/sde {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a7c66a-4f5c-4430-b360-8aaf3c06a1c0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85d79bce-38a7-4708-ae18-22467ad15886 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 415ca70b-eb7b-484d-925e-14fbd8980d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (8f3b70bc-49f7-41d1-83ac-bc539bcc795e): {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. Skipping heal of allocations during the task state transition. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ca43b2-d8a4-4f86-9b0b-34dbc208574d]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] SCSI volumes sde have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e43ee9-8ecb-47c3-b067-c9eb791ba7e7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bc8e95-313f-425e-b48c-467a6675eab2]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260]
Oct 30 14:17:39 user nova-compute[74319]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15, portal: 172.16.0.220,3260] successful.
Oct 30 14:17:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8520f0e1-dda3-49fb-81d5-6d72c22f622f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== disconnect_volume: return (370ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:17:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'flavor' on Instance uuid 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbbb302c-6888-45a7-8e79-065a6f5dd30e tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.417s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.077s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:40 user nova-compute[74319]: INFO nova.compute.manager [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Terminating instance
Oct 30 14:17:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-unplugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] No waiting events found dispatching network-vif-unplugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-d8b65aa9-b70d-4d98-ba5c-d9565714ad6b req-337a25cf-cc34-4d15-b2c5-be016ffe54ee service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-unplugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:17:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Instance destroyed successfully.
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lazy-loading 'resources' on Instance uuid 85d79bce-38a7-4708-ae18-22467ad15886 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:14:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1537828393',display_name='tempest-VolumesSnapshotTestJSON-instance-1537828393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1537828393',id=34,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgionHXrHJgR6pdJv3PyKSUwBOfEQZnnGT+XBGdE/nIwvjUNqDR2qe1J8Jl2g4BBfqFAad2QGqGBuZnWeYvUbyftZ6IBSMmrtdhdmync5wNOUyKCiAtR7lW7UyvBgXznw==',key_name='tempest-keypair-1618853568',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:14:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e304f9766008483988dba2ef27b88eb6',ramdisk_id='',reservation_id='r-12hi7c72',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1843196762',owner_user_name='tempest-VolumesSnapshotTestJSON-1843196762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:14:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0c7aa0d23b06429a979030bc57f68027',uuid=85d79bce-38a7-4708-ae18-22467ad15886,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converting VIF {"id": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "address": "fa:16:3e:17:08:c0", "network": {"id": "cd8e3807-42be-4d6b-8611-beda870bd17c", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1123927723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e304f9766008483988dba2ef27b88eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a745c2c-4c", "ovs_interfaceid": "3a745c2c-4c94-49d3-a7e3-44efaa673040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_vif [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a745c2c-4c, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b4b478d-0cb4-466e-a64a-15a79aed863a) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:41 user nova-compute[74319]: INFO os_vif [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:08:c0,bridge_name='br-int',has_traffic_filtering=True,id=3a745c2c-4c94-49d3-a7e3-44efaa673040,network=Network(cd8e3807-42be-4d6b-8611-beda870bd17c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a745c2c-4c')
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IGPAFylQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:17:41 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed8e98-ff03-494c-934f-1d1aca57cf6b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:17:41 user nova-compute[74319]: No targets found.
Oct 30 14:17:41 user nova-compute[74319]: iSNS:
Oct 30 14:17:41 user nova-compute[74319]: No targets found.
Oct 30 14:17:41 user nova-compute[74319]: STATIC:
Oct 30 14:17:41 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:17:41 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:41 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:41 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:17:41 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:41 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:41 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:17:41 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:41 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:41 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:17:41 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:17:41 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:17:41 user nova-compute[74319]: FIRMWARE:
Oct 30 14:17:41 user nova-compute[74319]: No targets found.
Oct 30 14:17:41 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:17:41 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:17:41 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0049d32-a818-4288-99a3-b9ba615edc15', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cc06cf-f979-49e3-a874-f794f2bfe96a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c3b47e-4f8d-44b0-a81a-45fed820d7d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:17:41 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99852b370>, {}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Disconnecting from: [] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] <== disconnect_volume: return (87ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:17:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Deleting instance files /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886_del
Oct 30 14:17:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Deletion of /opt/stack/data/nova/instances/85d79bce-38a7-4708-ae18-22467ad15886_del complete
Oct 30 14:17:41 user nova-compute[74319]: INFO nova.compute.manager [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 30 14:17:41 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:17:41 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:17:42 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:17:42 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Took 0.80 seconds to deallocate network for instance.
Oct 30 14:17:42 user nova-compute[74319]: WARNING nova.volume.cinder [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Attachment 8dfdd828-0b09-4a10-8870-16c22b51e705 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 8dfdd828-0b09-4a10-8870-16c22b51e705. (HTTP 404) (Request-ID: req-23eb3ae6-d6b6-4815-a04e-18df028440b4)
Oct 30 14:17:42 user nova-compute[74319]: INFO nova.compute.manager [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Took 0.02 seconds to detach 1 volumes for instance.
Oct 30 14:17:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:43 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Deleted allocations for instance 85d79bce-38a7-4708-ae18-22467ad15886
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] Acquiring lock "85d79bce-38a7-4708-ae18-22467ad15886-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] Lock "85d79bce-38a7-4708-ae18-22467ad15886-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] No waiting events found dispatching network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:17:43 user nova-compute[74319]: WARNING nova.compute.manager [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received unexpected event network-vif-plugged-3a745c2c-4c94-49d3-a7e3-44efaa673040 for instance with vm_state deleted and task_state None.
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-182d083e-4705-41f0-b5a3-5126a72ef51a req-53231d0c-07fe-4fb4-9f61-06e25d9d1664 service nova] [instance: 85d79bce-38a7-4708-ae18-22467ad15886] Received event network-vif-deleted-3a745c2c-4c94-49d3-a7e3-44efaa673040 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-260fa7ef-cbcf-4d38-82ff-c6165ae01303 tempest-VolumesSnapshotTestJSON-1843196762 tempest-VolumesSnapshotTestJSON-1843196762-project-member] Lock "85d79bce-38a7-4708-ae18-22467ad15886" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [{"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-78691de8-10df-403c-91d2-afc7594a413d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:17:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:17:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:17:59 user nova-compute[74319]: INFO nova.compute.manager [None req-f6692175-e7a7-41c2-a2a1-ced883a34322 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Get console output
Oct 30 14:17:59 user nova-compute[74319]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 30 14:18:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:31 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:18:33 user nova-compute[74319]: INFO nova.compute.claims [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Claim successful on node user
Oct 30 14:18:33 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:18:33 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:18:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.policy [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ceda8d86829d42ed8938c3b289d7c4be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c4545166182441c9a7507695a442cd0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:18:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Creating image(s)
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "/opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "/opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "/opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Successfully created port: ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk 1073741824" returned: 0 in 0.048s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:34 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Cannot resize image /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Ensure instance console log exists: /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-changed-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Refreshing instance network info cache due to event network-changed-4fe89742-4979-4ec5-acc1-9b926bb88cb9. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] Acquiring lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] Acquired lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.network.neutron [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Refreshing network info cache for port 4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Successfully updated port: ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquired lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:18:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Updating instance_info_cache with network_info: [{"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Releasing lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Instance network_info: |[{"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:18:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Start _get_guest_xml network_info=[{"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:18:36 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:18:36 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updated VIF entry in instance network info cache for port 4fe89742-4979-4ec5-acc1-9b926bb88cb9. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating instance_info_cache with network_info: [{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1603038000',display_name='tempest-VolumesActionsTest-instance-1603038000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1603038000',id=36,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c4545166182441c9a7507695a442cd0',ramdisk_id='',reservation_id='r-zth6h0x5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-964611803',owner_user_name='tempest-VolumesActionsTest-964611803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:18:34Z,user_data=None,user_id='ceda8d86829d42ed8938c3b289d7c4be',uuid=85563b7e-4dc5-4b2c-929e-50b9284ee5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converting VIF {"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.objects.instance [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lazy-loading 'pci_devices' on Instance uuid 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f566720c-5aa2-458f-a704-edf3e5f1ab1a req-919c6df6-e2cd-4985-abbe-d3e36bdabae4 service nova] Releasing lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:18:37 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:18:37 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.036903381347656GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:18:37 user nova-compute[74319]:   <uuid>85563b7e-4dc5-4b2c-929e-50b9284ee5f0</uuid>
Oct 30 14:18:37 user nova-compute[74319]:   <name>instance-00000024</name>
Oct 30 14:18:37 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:18:37 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:18:37 user nova-compute[74319]:   <metadata>
Oct 30 14:18:37 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:18:37 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:name>tempest-VolumesActionsTest-instance-1603038000</nova:name>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:18:36</nova:creationTime>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:18:37 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:18:37 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:owner>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:user uuid="ceda8d86829d42ed8938c3b289d7c4be">tempest-VolumesActionsTest-964611803-project-member</nova:user>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:project uuid="6c4545166182441c9a7507695a442cd0">tempest-VolumesActionsTest-964611803</nova:project>
Oct 30 14:18:37 user nova-compute[74319]:       </nova:owner>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:18:37 user nova-compute[74319]:       <nova:ports>
Oct 30 14:18:37 user nova-compute[74319]:         <nova:port uuid="ab253810-eed5-4597-99e5-3112fed82bd9">
Oct 30 14:18:37 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 14:18:37 user nova-compute[74319]:         </nova:port>
Oct 30 14:18:37 user nova-compute[74319]:       </nova:ports>
Oct 30 14:18:37 user nova-compute[74319]:     </nova:instance>
Oct 30 14:18:37 user nova-compute[74319]:   </metadata>
Oct 30 14:18:37 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:18:37 user nova-compute[74319]:     <system>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="serial">85563b7e-4dc5-4b2c-929e-50b9284ee5f0</entry>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="uuid">85563b7e-4dc5-4b2c-929e-50b9284ee5f0</entry>
Oct 30 14:18:37 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:18:37 user nova-compute[74319]:     </system>
Oct 30 14:18:37 user nova-compute[74319]:   </sysinfo>
Oct 30 14:18:37 user nova-compute[74319]:   <os>
Oct 30 14:18:37 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:18:37 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:18:37 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:18:37 user nova-compute[74319]:   </os>
Oct 30 14:18:37 user nova-compute[74319]:   <features>
Oct 30 14:18:37 user nova-compute[74319]:     <acpi/>
Oct 30 14:18:37 user nova-compute[74319]:     <apic/>
Oct 30 14:18:37 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:18:37 user nova-compute[74319]:   </features>
Oct 30 14:18:37 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:18:37 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:18:37 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:18:37 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:18:37 user nova-compute[74319]:   </clock>
Oct 30 14:18:37 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:18:37 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:18:37 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:18:37 user nova-compute[74319]:   </cpu>
Oct 30 14:18:37 user nova-compute[74319]:   <devices>
Oct 30 14:18:37 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:18:37 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:18:37 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk"/>
Oct 30 14:18:37 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:18:37 user nova-compute[74319]:     </disk>
Oct 30 14:18:37 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:18:37 user nova-compute[74319]:       <mac address="fa:16:3e:51:76:9a"/>
Oct 30 14:18:37 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:18:37 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:18:37 user nova-compute[74319]:       <target dev="tapab253810-ee"/>
Oct 30 14:18:37 user nova-compute[74319]:     </interface>
Oct 30 14:18:37 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:18:37 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/console.log" append="off"/>
Oct 30 14:18:37 user nova-compute[74319]:     </serial>
Oct 30 14:18:37 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:18:37 user nova-compute[74319]:     <video>
Oct 30 14:18:37 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:18:37 user nova-compute[74319]:     </video>
Oct 30 14:18:37 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:18:37 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:18:37 user nova-compute[74319]:     </rng>
Oct 30 14:18:37 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:18:37 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:18:37 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:18:37 user nova-compute[74319]:     </memballoon>
Oct 30 14:18:37 user nova-compute[74319]:   </devices>
Oct 30 14:18:37 user nova-compute[74319]: </domain>
Oct 30 14:18:37 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1603038000',display_name='tempest-VolumesActionsTest-instance-1603038000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1603038000',id=36,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c4545166182441c9a7507695a442cd0',ramdisk_id='',reservation_id='r-zth6h0x5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-964611803',owner_user_name='tempest-VolumesActionsTest-964611803-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:18:34Z,user_data=None,user_id='ceda8d86829d42ed8938c3b289d7c4be',uuid=85563b7e-4dc5-4b2c-929e-50b9284ee5f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converting VIF {"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG os_vif [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '420b4fe9-b28e-580e-9f4e-8af9d1d5873b', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab253810-ee, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab253810-ee, col_values=(('qos', UUID('dc3f4c25-e0cf-47bd-ae8f-dd0d71c1dcec')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab253810-ee, col_values=(('external_ids', {'iface-id': 'ab253810-eed5-4597-99e5-3112fed82bd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:76:9a', 'vm-uuid': '85563b7e-4dc5-4b2c-929e-50b9284ee5f0'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:37 user nova-compute[74319]: INFO os_vif [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee')
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] No VIF found with MAC fa:16:3e:51:76:9a, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5820195e-e4d1-44a4-86d8-25f003fca44a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 78691de8-10df-403c-91d2-afc7594a413d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 415ca70b-eb7b-484d-925e-14fbd8980d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5048109c-d671-4953-b819-fdb69e3052fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-changed-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Refreshing instance network info cache due to event network-changed-ab253810-eed5-4597-99e5-3112fed82bd9. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] Acquiring lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] Acquired lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Refreshing network info cache for port ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:18:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.486s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Updated VIF entry in instance network info cache for port ab253810-eed5-4597-99e5-3112fed82bd9. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Updating instance_info_cache with network_info: [{"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0d08a226-3a37-4857-872b-da3bb0e02a58 req-4386deeb-5a68-4d04-bcd9-477690e28ec0 service nova] Releasing lock "refresh_cache-85563b7e-4dc5-4b2c-929e-50b9284ee5f0" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] No waiting events found dispatching network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:18:39 user nova-compute[74319]: WARNING nova.compute.manager [req-0db1aeb8-1b2c-4568-8a83-69fcacd34da4 req-3ab02cda-e6a2-4da2-a601-b6efed13ba66 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received unexpected event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 for instance with vm_state building and task_state spawning.
Oct 30 14:18:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:18:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:18:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Instance spawned successfully.
Oct 30 14:18:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:18:41 user nova-compute[74319]: INFO nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Took 6.89 seconds to spawn the instance on the hypervisor.
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] No waiting events found dispatching network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:18:41 user nova-compute[74319]: WARNING nova.compute.manager [req-0deac617-4fe3-42bf-bb55-c0f76411b42a req-4bc75712-d55d-4675-b578-9f4d2863737a service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received unexpected event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 for instance with vm_state building and task_state spawning.
Oct 30 14:18:41 user nova-compute[74319]: INFO nova.compute.manager [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Took 7.55 seconds to build instance.
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-c571044b-1cc9-4fce-8f3b-8e29e228794f tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.646s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'flavor' on Instance uuid 415ca70b-eb7b-484d-925e-14fbd8980d7a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:41 user nova-compute[74319]: INFO nova.compute.manager [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Attaching volume 3f6b043c-f355-4fe2-84de-f7bd7d02627c to /dev/vdb
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.utils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dfbd6a-fc74-4974-ab86-defc4aa8c0c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93a8341-cbe6-43d0-9df0-6ce2689d71be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[01910ecc-94e3-40ab-868c-5dabae98e562]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a845b0-4d10-4e9f-b03d-be705495ccfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:18:42 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:18:42 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd88f98-77c2-4b5b-94a9-f63284b44658]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG os_brick.utils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating existing volume attachment record: 867f1517-bf9a-4ddd-9e0a-63a64d4abe39 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:18:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:18:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [{"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-fd2845ad-7fce-4307-b12e-d3b77fcaffa7" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:18:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:18:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:52 user nova-compute[74319]: INFO nova.compute.manager [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Terminating instance
Oct 30 14:18:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:18:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-a92845bf-e058-4269-8c4e-f6e1eb9facaf req-243fbdd8-d5b1-4e32-9079-1a9a53db672a service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-unplugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:18:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Instance destroyed successfully.
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 5820195e-e4d1-44a4-86d8-25f003fca44a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1463439560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1463439560',id=32,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:15:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ksogu7dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:17:06Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=5820195e-e4d1-44a4-86d8-25f003fca44a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "address": "fa:16:3e:2c:39:7f", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad6e3d1-e7", "ovs_interfaceid": "bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_vif [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad6e3d1-e7, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb7a6566-ae05-43f0-a06e-453910e4a86d) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:18:53 user nova-compute[74319]: INFO os_vif [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:39:7f,bridge_name='br-int',has_traffic_filtering=True,id=bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad6e3d1-e7')
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'idBqLVkx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:18:53 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09d94d3-e793-4698-8484-b20b43bc726e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:18:53 user nova-compute[74319]: No targets found.
Oct 30 14:18:53 user nova-compute[74319]: iSNS:
Oct 30 14:18:53 user nova-compute[74319]: No targets found.
Oct 30 14:18:53 user nova-compute[74319]: STATIC:
Oct 30 14:18:53 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:18:53 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:18:53 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:18:53 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:18:53 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:18:53 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:18:53 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:18:53 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:18:53 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:18:53 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0
Oct 30 14:18:53 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:18:53 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:18:53 user nova-compute[74319]: FIRMWARE:
Oct 30 14:18:53 user nova-compute[74319]: No targets found.
Oct 30 14:18:53 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:18:53 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:18:53 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ea5698-38ed-4bab-9992-91b4337c4152]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1cf85e-d6bc-4b45-8ed0-8b889d38b1c5]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:18:53 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998544d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06d52b2-bf01-4941-af86-801446fd2cf2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe40e837-70a4-40eb-8ac6-b71d09dc011e]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5815f2-d595-4671-83ae-4d5e0ac61bde]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e7fc5e-c605-4a56-8190-005b261ace19]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23663636265323337', '/dev/disk/by-id/scsi-1SCST_BIOfc6177b5-6ccbe237212dacfe', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fc6177b5') {{(pid=85349) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae6273-71d0-44ae-bc0e-3532327f9528]: (4, None) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24e268d-6365-4351-80bf-19fac250921f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[63591b31-38ac-402c-bd91-340aa943eb8f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260]
Oct 30 14:18:53 user nova-compute[74319]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0, portal: 172.16.0.220,3260] successful.
Oct 30 14:18:53 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ace075d9-7d66-4eda-a20b-def23d6c2ec0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc4f81-1267-4e55-81c9-291828066585]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== disconnect_volume: return (363ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:18:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Deleting instance files /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a_del
Oct 30 14:18:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Deletion of /opt/stack/data/nova/instances/5820195e-e4d1-44a4-86d8-25f003fca44a_del complete
Oct 30 14:18:53 user nova-compute[74319]: INFO nova.compute.manager [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 30 14:18:53 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:18:53 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:18:54 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Took 0.41 seconds to deallocate network for instance.
Oct 30 14:18:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-eb6072f4-12fc-4456-b09d-57eb84b92562 req-607cf01b-1369-425c-a14b-38db8785b80f service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-deleted-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] Acquiring lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] No waiting events found dispatching network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:18:54 user nova-compute[74319]: WARNING nova.compute.manager [req-2c82a59b-312c-4135-925b-522ce9ce05ce req-5f5a7159-1161-46e1-81f5-221c999e8042 service nova] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Received unexpected event network-vif-plugged-bad6e3d1-e7eb-41b7-8eab-47ff206a2fb8 for instance with vm_state active and task_state deleting.
Oct 30 14:18:55 user nova-compute[74319]: INFO nova.compute.manager [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 5820195e-e4d1-44a4-86d8-25f003fca44a] Took 0.86 seconds to detach 1 volumes for instance.
Oct 30 14:18:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.volume.cinder [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Update attachment failed for attachment 867f1517-bf9a-4ddd-9e0a-63a64d4abe39. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228)
Oct 30 14:18:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Failed to attach 3f6b043c-f355-4fe2-84de-f7bd7d02627c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Traceback (most recent call last):
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     ret_val = method(obj, context, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     self._do_attach(context, instance, volume, volume_api,
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     self._volume_attach(context, volume, connector, instance,
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     connection_info = volume_api.attachment_update(
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     res = method(self, ctx, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     return method.func(obj, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     resp = self._update('/attachments/%s' % id, body)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     return self.request(url, method, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a]     raise exceptions.from_response(resp, body)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228)
Oct 30 14:18:55 user nova-compute[74319]: ERROR nova.compute.manager [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] 
Oct 30 14:18:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:18:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:55 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Deleted allocations for instance 5820195e-e4d1-44a4-86d8-25f003fca44a
Oct 30 14:18:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.511s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server [None req-71604deb-a229-41af-baed-b00079a82b7f tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2e2d08c7-512a-4939-9c20-0ab29ffec228)
Oct 30 14:18:55 user nova-compute[74319]: ERROR oslo_messaging.rpc.server 
Oct 30 14:18:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7490b8f8-d317-4b73-aa5c-09b63922437a tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "5820195e-e4d1-44a4-86d8-25f003fca44a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.105s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:18:59 user nova-compute[74319]: INFO nova.compute.manager [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Terminating instance
Oct 30 14:18:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:18:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.compute.manager [req-a4529ee1-8eb9-4628-a475-84b87f4de09c req-b71c55e4-2b94-447f-99c5-1d00533b2961 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-unplugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:19:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Instance destroyed successfully.
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'resources' on Instance uuid 78691de8-10df-403c-91d2-afc7594a413d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:12:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-16653019',display_name='tempest-ServerActionsTestOtherA-server-16653019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-16653019',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:14:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-grh0c082',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=78691de8-10df-403c-91d2-afc7594a413d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "address": "fa:16:3e:a6:cd:72", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa6539d-c8", "ovs_interfaceid": "bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_vif [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfa6539d-c8, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e46aab88-f428-4803-8d94-8aaad0400920) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: INFO os_vif [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:cd:72,bridge_name='br-int',has_traffic_filtering=True,id=bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa6539d-c8')
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WAMyJLIx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:19:00 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bae704e-f944-46cb-b524-f2983ed2ebd4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:19:00 user nova-compute[74319]: No targets found.
Oct 30 14:19:00 user nova-compute[74319]: iSNS:
Oct 30 14:19:00 user nova-compute[74319]: No targets found.
Oct 30 14:19:00 user nova-compute[74319]: STATIC:
Oct 30 14:19:00 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31
Oct 30 14:19:00 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:19:00 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:19:00 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:19:00 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:19:00 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:19:00 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:19:00 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:19:00 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:19:00 user nova-compute[74319]: FIRMWARE:
Oct 30 14:19:00 user nova-compute[74319]: No targets found.
Oct 30 14:19:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:19:00 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:19:00 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[12603d37-b3c6-49aa-9533-e5f235aa0ac4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd46726-4619-42c7-9c4a-91a48c92856c]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:19:00 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:19:00 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:19:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:19:00 user nova-compute[74319]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 (non-flash)
Oct 30 14:19:00 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:19:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99869b250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138fc50-2318-4a52-bf89-3ad7043dd68d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[498ebc26-9bff-487f-b2c3-ab939bf68da5]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4926a01-f6d9-4a92-9c12-73c002867328]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5218a7-63ae-4593-94d4-24bda270b9f9]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1d97d30',) {{(pid=85349) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831bb15-7d5f-4f81-a4f4-7efebc6fda21]: (4, None) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3147d9c-4eca-4cd1-b437-720cf5605803]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c5e84d-c38c-4a45-a533-f9c52524cccd]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260]
Oct 30 14:19:00 user nova-compute[74319]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31, portal: 172.16.0.220,3260] successful.
Oct 30 14:19:00 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1633576e-e50b-4953-b9b6-ab8c9d430b31 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcf4e5c-d4f3-45e6-9e23-47a943303711]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] <== disconnect_volume: return (313ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:19:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:19:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Deleting instance files /opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d_del
Oct 30 14:19:00 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Deletion of /opt/stack/data/nova/instances/78691de8-10df-403c-91d2-afc7594a413d_del complete
Oct 30 14:19:01 user nova-compute[74319]: INFO nova.compute.manager [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 30 14:19:01 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:19:01 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:19:01 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:19:01 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:01 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Took 0.64 seconds to deallocate network for instance.
Oct 30 14:19:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-5d6e60dd-e5cc-49a5-8630-bb3cf7340905 req-567ea0a5-2711-4053-8fc5-d357135387f7 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-deleted-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] Acquiring lock "78691de8-10df-403c-91d2-afc7594a413d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] Lock "78691de8-10df-403c-91d2-afc7594a413d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] No waiting events found dispatching network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:02 user nova-compute[74319]: WARNING nova.compute.manager [req-5adea07b-b372-4f40-a3ca-4d4374dcad4f req-b521049f-fbfd-42ee-97d0-9e79fe5eb5a5 service nova] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Received unexpected event network-vif-plugged-bfa6539d-c8a2-41dc-8f7f-4efc83d2b51f for instance with vm_state active and task_state deleting.
Oct 30 14:19:02 user nova-compute[74319]: INFO nova.compute.manager [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Took 0.87 seconds to detach 1 volumes for instance.
Oct 30 14:19:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: 78691de8-10df-403c-91d2-afc7594a413d] Deleting volume: 1633576e-e50b-4953-b9b6-ab8c9d430b31 {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:19:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.272s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:03 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Deleted allocations for instance 78691de8-10df-403c-91d2-afc7594a413d
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-612c929a-3bb7-4dca-8898-c2ffaa8cbd0d tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "78691de8-10df-403c-91d2-afc7594a413d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:03 user nova-compute[74319]: INFO nova.compute.manager [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Terminating instance
Oct 30 14:19:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing instance network info cache due to event network-changed-8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] Acquiring lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] Acquired lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Refreshing network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Instance destroyed successfully.
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.objects.instance [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lazy-loading 'resources' on Instance uuid 5048109c-d671-4953-b819-fdb69e3052fa {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-30T14:13:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1149684489',display_name='tempest-TestShelveInstance-server-1149684489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1149684489',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdP9qy65aGRzPvBVvvYInx9XgQMNetAWvJWaPPJbeVYG7pja9CsUPMH2bOIPmjS+VJNiMC4Z6ynLByOxDS9HLrMlyaZQNIEJTdw2nNIr2Oq2vqN1M9cy77Ox4vwv+Ivqw==',key_name='tempest-TestShelveInstance-77344443',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:17:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46c403cd3f6549a3b44268ae4f36fa9b',ramdisk_id='',reservation_id='r-6m4jt2rd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-676790378',owner_user_name='tempest-TestShelveInstance-676790378-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:17:40Z,user_data=None,user_id='e1384ea11d244bb3b5bbd47634caef19',uuid=5048109c-d671-4953-b819-fdb69e3052fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converting VIF {"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_vif [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f366e93-d4, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f40aee51-413c-4bc3-a2f1-7df0fd7d728b) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:04 user nova-compute[74319]: INFO os_vif [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:13:6d,bridge_name='br-int',has_traffic_filtering=True,id=8f366e93-d46f-45a4-935c-f9b8ac07b031,network=Network(610b1571-3145-4b75-877f-8370ba387743),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f366e93-d4')
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BbUCryHu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:19:04 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb647061-398f-4379-a566-d998db3d15a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:19:04 user nova-compute[74319]: No targets found.
Oct 30 14:19:04 user nova-compute[74319]: iSNS:
Oct 30 14:19:04 user nova-compute[74319]: No targets found.
Oct 30 14:19:04 user nova-compute[74319]: STATIC:
Oct 30 14:19:04 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:19:04 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:19:04 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:19:04 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572
Oct 30 14:19:04 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:19:04 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:19:04 user nova-compute[74319]: FIRMWARE:
Oct 30 14:19:04 user nova-compute[74319]: No targets found.
Oct 30 14:19:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:19:04 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:19:04 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c32998d-fce3-48f5-b697-f51675845a0f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b5d61-173a-4516-9e3e-6217d6332de1]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:19:04 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:19:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:19:04 user nova-compute[74319]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 (non-flash)
Oct 30 14:19:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99863f130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572'): ({'sdf'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Removing single pathed devices sdf {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ee8aa1-a448-43f6-9642-84609976092d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf634ae-ce6c-4aea-b517-a310387ddedd]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Flushing IO for device /dev/sdf {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a496ac0-aa78-4cfa-ba06-1c36d1ec21ec]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updated VIF entry in instance network info cache for port 8f366e93-d46f-45a4-935c-f9b8ac07b031. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [{"id": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "address": "fa:16:3e:89:13:6d", "network": {"id": "610b1571-3145-4b75-877f-8370ba387743", "bridge": "br-int", "label": "tempest-TestShelveInstance-729627365-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46c403cd3f6549a3b44268ae4f36fa9b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f366e93-d4", "ovs_interfaceid": "8f366e93-d46f-45a4-935c-f9b8ac07b031", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cac0888a-7d5b-44a7-8749-73c2ee321c93 req-731625a0-2faa-4b5e-9ab6-3c16ecad601a service nova] Releasing lock "refresh_cache-5048109c-d671-4953-b819-fdb69e3052fa" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.094s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb107115-e017-495e-8793-13d3fbb4ed6a]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] SCSI volumes sdf have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16dfc76-1a16-4283-815c-c2cf2817b14d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f908327-a9f3-4978-98f0-451971b0e82d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260]
Oct 30 14:19:05 user nova-compute[74319]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572, portal: 172.16.0.220,3260] successful.
Oct 30 14:19:05 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[83636e9e-e072-47d5-82af-35fbde4ffa57]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.405s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] <== disconnect_volume: return (407ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:19:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deleting instance files /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa_del
Oct 30 14:19:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deletion of /opt/stack/data/nova/instances/5048109c-d671-4953-b819-fdb69e3052fa_del complete
Oct 30 14:19:05 user nova-compute[74319]: INFO nova.compute.manager [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Took 1.41 seconds to destroy the instance on the hypervisor.
Oct 30 14:19:05 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:05 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Took 0.57 seconds to deallocate network for instance.
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-9d0603bc-a855-4f47-b342-66edd76767df req-784fd91d-accf-42a2-b893-b54948098396 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-deleted-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:05 user nova-compute[74319]: INFO nova.compute.manager [req-9d0603bc-a855-4f47-b342-66edd76767df req-784fd91d-accf-42a2-b893-b54948098396 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Neutron deleted interface 8f366e93-d46f-45a4-935c-f9b8ac07b031; detaching it from the instance and deleting it from the info cache
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.network.neutron [req-9d0603bc-a855-4f47-b342-66edd76767df req-784fd91d-accf-42a2-b893-b54948098396 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-9d0603bc-a855-4f47-b342-66edd76767df req-784fd91d-accf-42a2-b893-b54948098396 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Detach interface failed, port_id=8f366e93-d46f-45a4-935c-f9b8ac07b031, reason: Instance 5048109c-d671-4953-b819-fdb69e3052fa could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:19:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: WARNING nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state deleting.
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: WARNING nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state deleting.
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: WARNING nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state deleting.
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-unplugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Acquiring lock "5048109c-d671-4953-b819-fdb69e3052fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] Lock "5048109c-d671-4953-b819-fdb69e3052fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] No waiting events found dispatching network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:06 user nova-compute[74319]: WARNING nova.compute.manager [req-b1eba60c-bacb-4a91-a574-34a40d059a22 req-a2fe7bb6-de37-4ab1-8e5d-27983f4af471 service nova] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Received unexpected event network-vif-plugged-8f366e93-d46f-45a4-935c-f9b8ac07b031 for instance with vm_state active and task_state deleting.
Oct 30 14:19:06 user nova-compute[74319]: INFO nova.compute.manager [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Took 0.84 seconds to detach 1 volumes for instance.
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] [instance: 5048109c-d671-4953-b819-fdb69e3052fa] Deleting volume: 70ec54b9-c9c6-4fd6-8ef0-ac08dedde572 {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:19:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:07 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Deleted allocations for instance 5048109c-d671-4953-b819-fdb69e3052fa
Oct 30 14:19:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d05c6467-533d-448d-8d6f-8cfd91f6af70 tempest-TestShelveInstance-676790378 tempest-TestShelveInstance-676790378-project-member] Lock "5048109c-d671-4953-b819-fdb69e3052fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:19:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:33 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:35 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:19:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:19:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8359MB free_disk=24.997756958007812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 6c5db4aa-4158-4870-8465-bf738b5e1b30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 415ca70b-eb7b-484d-925e-14fbd8980d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:19:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:43 user nova-compute[74319]: INFO nova.compute.manager [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Terminating instance
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-unplugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] No waiting events found dispatching network-vif-unplugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-8f81ec40-77ad-4b94-9b96-93583c816393 req-65cf2b77-7dbe-457d-9232-e8e14d4efe47 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-unplugged-3dea0b00-08cc-4a00-8e19-83201a573774 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Instance destroyed successfully.
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 6c5db4aa-4158-4870-8465-bf738b5e1b30 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-249176932',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-249176932',id=28,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:09:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-ji7a9obh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:11:27Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=6c5db4aa-4158-4870-8465-bf738b5e1b30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "3dea0b00-08cc-4a00-8e19-83201a573774", "address": "fa:16:3e:46:49:83", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dea0b00-08", "ovs_interfaceid": "3dea0b00-08cc-4a00-8e19-83201a573774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG os_vif [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dea0b00-08, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d8a0312-32e7-402e-b69f-a64481a872ef) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:43 user nova-compute[74319]: INFO os_vif [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:49:83,bridge_name='br-int',has_traffic_filtering=True,id=3dea0b00-08cc-4a00-8e19-83201a573774,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dea0b00-08')
Oct 30 14:19:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Deleting instance files /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30_del
Oct 30 14:19:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Deletion of /opt/stack/data/nova/instances/6c5db4aa-4158-4870-8465-bf738b5e1b30_del complete
Oct 30 14:19:43 user nova-compute[74319]: INFO nova.compute.manager [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 30 14:19:43 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:19:43 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:44 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Took 0.46 seconds to deallocate network for instance.
Oct 30 14:19:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:44 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Deleted allocations for instance 6c5db4aa-4158-4870-8465-bf738b5e1b30
Oct 30 14:19:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-314a0d1c-5022-434a-aa6a-92bfc6cd9f0b tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.594s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] Acquiring lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] Lock "6c5db4aa-4158-4870-8465-bf738b5e1b30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] No waiting events found dispatching network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:19:45 user nova-compute[74319]: WARNING nova.compute.manager [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received unexpected event network-vif-plugged-3dea0b00-08cc-4a00-8e19-83201a573774 for instance with vm_state deleted and task_state None.
Oct 30 14:19:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-94c5bfe6-22d7-43a2-9014-5f67c52ca59e req-a84672c7-0af8-4c77-8958-2299b7bfa9e3 service nova] [instance: 6c5db4aa-4158-4870-8465-bf738b5e1b30] Received event network-vif-deleted-3dea0b00-08cc-4a00-8e19-83201a573774 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [{"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-7ce4683d-18d7-47cb-9f2e-15a53c528d82" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:19:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:19:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:19:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:19:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:19:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:01 user nova-compute[74319]: INFO nova.compute.manager [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Terminating instance
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-unplugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] No waiting events found dispatching network-vif-unplugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-79596318-3e4e-4a59-9881-0b1cc6b4603e req-78d2b30e-d136-41df-b331-bcecf8ed3885 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-unplugged-ad5624f5-c85a-4fe9-9388-c45039fd474c for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:20:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Instance destroyed successfully.
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lazy-loading 'resources' on Instance uuid fd2845ad-7fce-4307-b12e-d3b77fcaffa7 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900057634',display_name='tempest-ServerActionsTestOtherA-server-1900057634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900057634',id=14,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA34y6gbXRITM4qdostIq2O9ku8ymDhh64o4jVeI4vNPMedac7d0j43Ye8ugT+qcekxjK5qHbAeeSMvOC28jf5BKA/5iFfodJ4SPDdWVRMYRxzIEyQfV0VvJPwX3RsT45A==',key_name='tempest-keypair-520174451',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:00:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ae8f2e2f199408596776c53c41a7986',ramdisk_id='',reservation_id='r-90wn82ad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-768990641',owner_user_name='tempest-ServerActionsTestOtherA-768990641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:00:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d03a462b75b14b4fb30f66a3b0e051d4',uuid=fd2845ad-7fce-4307-b12e-d3b77fcaffa7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converting VIF {"id": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "address": "fa:16:3e:2c:3b:a9", "network": {"id": "52b31f3c-b8ed-4f38-a777-260242d6a5f2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2051465681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ae8f2e2f199408596776c53c41a7986", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad5624f5-c8", "ovs_interfaceid": "ad5624f5-c85a-4fe9-9388-c45039fd474c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG os_vif [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad5624f5-c8, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=303a233e-842a-4ead-9c81-bb46170369ef) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:01 user nova-compute[74319]: INFO os_vif [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:3b:a9,bridge_name='br-int',has_traffic_filtering=True,id=ad5624f5-c85a-4fe9-9388-c45039fd474c,network=Network(52b31f3c-b8ed-4f38-a777-260242d6a5f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad5624f5-c8')
Oct 30 14:20:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Deleting instance files /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7_del
Oct 30 14:20:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Deletion of /opt/stack/data/nova/instances/fd2845ad-7fce-4307-b12e-d3b77fcaffa7_del complete
Oct 30 14:20:01 user nova-compute[74319]: INFO nova.compute.manager [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 30 14:20:01 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:20:01 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:20:02 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Took 0.43 seconds to deallocate network for instance.
Oct 30 14:20:02 user nova-compute[74319]: DEBUG nova.compute.manager [req-76de7783-2be7-4f40-9905-32e4f3e76cec req-1d2f8192-2632-4461-849e-8d9eb9b72399 service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-deleted-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:20:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:02 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Deleted allocations for instance fd2845ad-7fce-4307-b12e-d3b77fcaffa7
Oct 30 14:20:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-0654a63f-2fce-4c54-b6fe-8d1f00597b86 tempest-ServerActionsTestOtherA-768990641 tempest-ServerActionsTestOtherA-768990641-project-member] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.511s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] Acquiring lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] Lock "fd2845ad-7fce-4307-b12e-d3b77fcaffa7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] No waiting events found dispatching network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:03 user nova-compute[74319]: WARNING nova.compute.manager [req-947d61e0-fd77-425e-bae1-8c23dbe79166 req-8a101eb2-d160-4c9e-bda0-2409b3dfd5be service nova] [instance: fd2845ad-7fce-4307-b12e-d3b77fcaffa7] Received unexpected event network-vif-plugged-ad5624f5-c85a-4fe9-9388-c45039fd474c for instance with vm_state deleted and task_state None.
Oct 30 14:20:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:33 user nova-compute[74319]: INFO nova.compute.manager [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Terminating instance
Oct 30 14:20:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b424639-7fe4-47d5-b9e7-a37abeddf88e req-59418545-d642-4e97-9f96-4a85c8204597 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-unplugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Instance destroyed successfully.
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.objects.instance [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:03:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1439463144',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1439463144',id=20,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:05:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-jx544glu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:07:43Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=3fb6cc13-e069-46bc-9b0b-50fe57103fd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "address": "fa:16:3e:c1:b4:48", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6c1c1c5-d0", "ovs_interfaceid": "b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_vif [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6c1c1c5-d0, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78122110-d326-45da-8118-8247b888eb39) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:34 user nova-compute[74319]: INFO os_vif [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:b4:48,bridge_name='br-int',has_traffic_filtering=True,id=b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6c1c1c5-d0')
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrjeKdys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:20:34 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6995ca63-bb8b-4ebb-b804-51b13e999d5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:20:34 user nova-compute[74319]: No targets found.
Oct 30 14:20:34 user nova-compute[74319]: iSNS:
Oct 30 14:20:34 user nova-compute[74319]: No targets found.
Oct 30 14:20:34 user nova-compute[74319]: STATIC:
Oct 30 14:20:34 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f
Oct 30 14:20:34 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:20:34 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:20:34 user nova-compute[74319]: FIRMWARE:
Oct 30 14:20:34 user nova-compute[74319]: No targets found.
Oct 30 14:20:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:20:34 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:20:34 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93b1ca5-38c5-4de7-b080-fb6fcc3e0d2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[354001cc-f43e-4269-82d5-044efbde8b79]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:20:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f (non-flash)
Oct 30 14:20:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a02837f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[906966c3-813d-4f41-820b-e6dee4fe8508]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9426df-5e50-4e44-ae37-446967e16fba]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c7d1a7-7036-41a3-acd4-2e544c9a8920]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcc5eab-8eac-460c-96d5-cd94d6b28573]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd8f7b-c88a-4f21-b136-86c03bf0a8f7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d773df-f478-4410-848d-99cdbc4a9b42]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260]
Oct 30 14:20:34 user nova-compute[74319]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f, portal: 172.16.0.220,3260] successful.
Oct 30 14:20:34 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af4e65e-97af-4a89-b347-79e53e94f14f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d9441-fc31-4e96-b8ed-39d83c32efcb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] <== disconnect_volume: return (300ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:20:34 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:20:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Deleting instance files /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5_del
Oct 30 14:20:34 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Deletion of /opt/stack/data/nova/instances/3fb6cc13-e069-46bc-9b0b-50fe57103fd5_del complete
Oct 30 14:20:35 user nova-compute[74319]: INFO nova.compute.manager [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 30 14:20:35 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:20:35 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:20:35 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:20:35 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:20:35 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Took 0.42 seconds to deallocate network for instance.
Oct 30 14:20:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-e7f45f28-b07b-4d83-b330-798a0f603926 req-2131ca13-e1f5-4a07-97f9-d5f9e659f193 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-deleted-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] Acquiring lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG nova.compute.manager [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] No waiting events found dispatching network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:36 user nova-compute[74319]: WARNING nova.compute.manager [req-2648da93-7483-4fe6-b864-11702e335a6d req-7c1e7121-5edc-4486-b667-c7c385efbba5 service nova] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Received unexpected event network-vif-plugged-b6c1c1c5-d0ec-46cf-85fc-940e54b3afd9 for instance with vm_state active and task_state deleting.
Oct 30 14:20:36 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:36 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:20:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:20:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8591MB free_disk=25.147369384765625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 415ca70b-eb7b-484d-925e-14fbd8980d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:20:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:20:39 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:20:39 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:20:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:20:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.341s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:41 user nova-compute[74319]: INFO nova.compute.manager [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 3fb6cc13-e069-46bc-9b0b-50fe57103fd5] Took 6.43 seconds to detach 1 volumes for instance.
Oct 30 14:20:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Deleted allocations for instance 3fb6cc13-e069-46bc-9b0b-50fe57103fd5
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.compute.manager [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Terminating instance
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77efbeff-442d-4c2d-80ee-a35046e48474 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "3fb6cc13-e069-46bc-9b0b-50fe57103fd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.445s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-unplugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] No waiting events found dispatching network-vif-unplugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-3b0a00bb-03f8-41ad-aa19-7eb4c5c81e92 req-483b31c9-f7e7-4933-bb88-dc2fc17cc7e1 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-unplugged-ab253810-eed5-4597-99e5-3112fed82bd9 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Instance destroyed successfully.
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.objects.instance [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lazy-loading 'resources' on Instance uuid 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:18:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1603038000',display_name='tempest-VolumesActionsTest-instance-1603038000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1603038000',id=36,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c4545166182441c9a7507695a442cd0',ramdisk_id='',reservation_id='r-zth6h0x5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-964611803',owner_user_name='tempest-VolumesActionsTest-964611803-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:18:41Z,user_data=None,user_id='ceda8d86829d42ed8938c3b289d7c4be',uuid=85563b7e-4dc5-4b2c-929e-50b9284ee5f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converting VIF {"id": "ab253810-eed5-4597-99e5-3112fed82bd9", "address": "fa:16:3e:51:76:9a", "network": {"id": "e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1954553683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c4545166182441c9a7507695a442cd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab253810-ee", "ovs_interfaceid": "ab253810-eed5-4597-99e5-3112fed82bd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG os_vif [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab253810-ee, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc3f4c25-e0cf-47bd-ae8f-dd0d71c1dcec) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:42 user nova-compute[74319]: INFO os_vif [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:76:9a,bridge_name='br-int',has_traffic_filtering=True,id=ab253810-eed5-4597-99e5-3112fed82bd9,network=Network(e57e43ba-1f1f-42aa-9e8a-ac056e5ef79e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapab253810-ee')
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Deleting instance files /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0_del
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Deletion of /opt/stack/data/nova/instances/85563b7e-4dc5-4b2c-929e-50b9284ee5f0_del complete
Oct 30 14:20:42 user nova-compute[74319]: INFO nova.compute.manager [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Took 0.68 seconds to destroy the instance on the hypervisor.
Oct 30 14:20:42 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:20:42 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:20:43 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Took 0.56 seconds to deallocate network for instance.
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-43b8423e-459f-4876-ae87-49ed76e2e4de req-0a12d100-b600-4159-a479-7260e35f21f5 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-deleted-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:43 user nova-compute[74319]: INFO nova.compute.manager [req-43b8423e-459f-4876-ae87-49ed76e2e4de req-0a12d100-b600-4159-a479-7260e35f21f5 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Neutron deleted interface ab253810-eed5-4597-99e5-3112fed82bd9; detaching it from the instance and deleting it from the info cache
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-43b8423e-459f-4876-ae87-49ed76e2e4de req-0a12d100-b600-4159-a479-7260e35f21f5 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-43b8423e-459f-4876-ae87-49ed76e2e4de req-0a12d100-b600-4159-a479-7260e35f21f5 service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Detach interface failed, port_id=ab253810-eed5-4597-99e5-3112fed82bd9, reason: Instance 85563b7e-4dc5-4b2c-929e-50b9284ee5f0 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:20:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:43 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Deleted allocations for instance 85563b7e-4dc5-4b2c-929e-50b9284ee5f0
Oct 30 14:20:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-6dcb6cb5-578a-4879-aa03-a722bf81cd82 tempest-VolumesActionsTest-964611803 tempest-VolumesActionsTest-964611803-project-member] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.559s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] Acquiring lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] Lock "85563b7e-4dc5-4b2c-929e-50b9284ee5f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] No waiting events found dispatching network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:20:44 user nova-compute[74319]: WARNING nova.compute.manager [req-74ce8cf5-7031-43a2-8594-97fe37bb68b2 req-2cb53ceb-3101-4d83-b2ba-328826c00b2e service nova] [instance: 85563b7e-4dc5-4b2c-929e-50b9284ee5f0] Received unexpected event network-vif-plugged-ab253810-eed5-4597-99e5-3112fed82bd9 for instance with vm_state deleted and task_state None.
Oct 30 14:20:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:45 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:20:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating instance_info_cache with network_info: [{"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-415ca70b-eb7b-484d-925e-14fbd8980d7a" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:20:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 7ce4683d-18d7-47cb-9f2e-15a53c528d82 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 415ca70b-eb7b-484d-925e-14fbd8980d7a {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:20:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:20:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:21:03 user nova-compute[74319]: INFO nova.compute.claims [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Claim successful on node user
Oct 30 14:21:03 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:21:03 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.256s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:21:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.policy [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cb6730193bd453fbefe85bfd5e26de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e35c5eed5f4e1ab46fbf58a8f7534c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:21:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Creating image(s)
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk 1073741824" returned: 0 in 0.047s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:21:04 user nova-compute[74319]: INFO nova.compute.claims [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Claim successful on node user
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Cannot resize image /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Ensure instance console log exists: /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Successfully created port: f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:21:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:21:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Creating image(s)
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG nova.policy [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cb6730193bd453fbefe85bfd5e26de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e35c5eed5f4e1ab46fbf58a8f7534c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.222s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk 1073741824" returned: 0 in 0.056s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Successfully updated port: f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-changed-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Refreshing instance network info cache due to event network-changed-f0aa1859-da9f-4143-8deb-6a8dbb3919cd. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Successfully created port: 96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Cannot resize image /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Ensure instance console log exists: /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance network_info: |[{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.neutron [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Refreshing network info cache for port f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start _get_guest_xml network_info=[{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:21:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-515377218',display_name='tempest-ServerRescueNegativeTestJSON-server-515377218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-515377218',id=37,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-0nkuezy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:04Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9785d1bd-6e07-40a5-af8d-41eaf909759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.objects.instance [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:21:06 user nova-compute[74319]:   <uuid>9785d1bd-6e07-40a5-af8d-41eaf909759e</uuid>
Oct 30 14:21:06 user nova-compute[74319]:   <name>instance-00000025</name>
Oct 30 14:21:06 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:21:06 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:21:06 user nova-compute[74319]:   <metadata>
Oct 30 14:21:06 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:21:06 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-515377218</nova:name>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:21:06</nova:creationTime>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:21:06 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:21:06 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:owner>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:21:06 user nova-compute[74319]:       </nova:owner>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:21:06 user nova-compute[74319]:       <nova:ports>
Oct 30 14:21:06 user nova-compute[74319]:         <nova:port uuid="f0aa1859-da9f-4143-8deb-6a8dbb3919cd">
Oct 30 14:21:06 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:21:06 user nova-compute[74319]:         </nova:port>
Oct 30 14:21:06 user nova-compute[74319]:       </nova:ports>
Oct 30 14:21:06 user nova-compute[74319]:     </nova:instance>
Oct 30 14:21:06 user nova-compute[74319]:   </metadata>
Oct 30 14:21:06 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:21:06 user nova-compute[74319]:     <system>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="serial">9785d1bd-6e07-40a5-af8d-41eaf909759e</entry>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="uuid">9785d1bd-6e07-40a5-af8d-41eaf909759e</entry>
Oct 30 14:21:06 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:21:06 user nova-compute[74319]:     </system>
Oct 30 14:21:06 user nova-compute[74319]:   </sysinfo>
Oct 30 14:21:06 user nova-compute[74319]:   <os>
Oct 30 14:21:06 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:21:06 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:21:06 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:21:06 user nova-compute[74319]:   </os>
Oct 30 14:21:06 user nova-compute[74319]:   <features>
Oct 30 14:21:06 user nova-compute[74319]:     <acpi/>
Oct 30 14:21:06 user nova-compute[74319]:     <apic/>
Oct 30 14:21:06 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:21:06 user nova-compute[74319]:   </features>
Oct 30 14:21:06 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:21:06 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:21:06 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:21:06 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:21:06 user nova-compute[74319]:   </clock>
Oct 30 14:21:06 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:21:06 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:21:06 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:21:06 user nova-compute[74319]:   </cpu>
Oct 30 14:21:06 user nova-compute[74319]:   <devices>
Oct 30 14:21:06 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:21:06 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:21:06 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk"/>
Oct 30 14:21:06 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:21:06 user nova-compute[74319]:     </disk>
Oct 30 14:21:06 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:21:06 user nova-compute[74319]:       <mac address="fa:16:3e:ff:aa:7d"/>
Oct 30 14:21:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:21:06 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:21:06 user nova-compute[74319]:       <target dev="tapf0aa1859-da"/>
Oct 30 14:21:06 user nova-compute[74319]:     </interface>
Oct 30 14:21:06 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:21:06 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/console.log" append="off"/>
Oct 30 14:21:06 user nova-compute[74319]:     </serial>
Oct 30 14:21:06 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:21:06 user nova-compute[74319]:     <video>
Oct 30 14:21:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:21:06 user nova-compute[74319]:     </video>
Oct 30 14:21:06 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:21:06 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:21:06 user nova-compute[74319]:     </rng>
Oct 30 14:21:06 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:21:06 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:21:06 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:21:06 user nova-compute[74319]:     </memballoon>
Oct 30 14:21:06 user nova-compute[74319]:   </devices>
Oct 30 14:21:06 user nova-compute[74319]: </domain>
Oct 30 14:21:06 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-515377218',display_name='tempest-ServerRescueNegativeTestJSON-server-515377218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-515377218',id=37,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-0nkuezy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:04Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9785d1bd-6e07-40a5-af8d-41eaf909759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG os_vif [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b813611-8b4d-5aba-801e-fdda7461e4ca', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0aa1859-da, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0aa1859-da, col_values=(('qos', UUID('ccfa8d75-7875-457e-816c-15555424a3b9')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0aa1859-da, col_values=(('external_ids', {'iface-id': 'f0aa1859-da9f-4143-8deb-6a8dbb3919cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:aa:7d', 'vm-uuid': '9785d1bd-6e07-40a5-af8d-41eaf909759e'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:07 user nova-compute[74319]: INFO os_vif [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da')
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:ff:aa:7d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated VIF entry in instance network info cache for port f0aa1859-da9f-4143-8deb-6a8dbb3919cd. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e3e63034-69e4-43c1-9339-c8390e56b827 req-7d2a09fa-87f4-4f6d-a396-37134169e12c service nova] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Successfully updated port: 96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance network_info: |[{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start _get_guest_xml network_info=[{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:21:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477593427',display_name='tempest-ServerRescueNegativeTestJSON-server-1477593427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477593427',id=38,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-xvk1f5n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:05Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9069a745-a232-47f6-b6a3-cde3ba8c8afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:21:07 user nova-compute[74319]:   <uuid>9069a745-a232-47f6-b6a3-cde3ba8c8afb</uuid>
Oct 30 14:21:07 user nova-compute[74319]:   <name>instance-00000026</name>
Oct 30 14:21:07 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:21:07 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:21:07 user nova-compute[74319]:   <metadata>
Oct 30 14:21:07 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:21:07 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1477593427</nova:name>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:21:07</nova:creationTime>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:21:07 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:21:07 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:owner>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:21:07 user nova-compute[74319]:       </nova:owner>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:21:07 user nova-compute[74319]:       <nova:ports>
Oct 30 14:21:07 user nova-compute[74319]:         <nova:port uuid="96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d">
Oct 30 14:21:07 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:21:07 user nova-compute[74319]:         </nova:port>
Oct 30 14:21:07 user nova-compute[74319]:       </nova:ports>
Oct 30 14:21:07 user nova-compute[74319]:     </nova:instance>
Oct 30 14:21:07 user nova-compute[74319]:   </metadata>
Oct 30 14:21:07 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:21:07 user nova-compute[74319]:     <system>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="serial">9069a745-a232-47f6-b6a3-cde3ba8c8afb</entry>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="uuid">9069a745-a232-47f6-b6a3-cde3ba8c8afb</entry>
Oct 30 14:21:07 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:21:07 user nova-compute[74319]:     </system>
Oct 30 14:21:07 user nova-compute[74319]:   </sysinfo>
Oct 30 14:21:07 user nova-compute[74319]:   <os>
Oct 30 14:21:07 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:21:07 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:21:07 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:21:07 user nova-compute[74319]:   </os>
Oct 30 14:21:07 user nova-compute[74319]:   <features>
Oct 30 14:21:07 user nova-compute[74319]:     <acpi/>
Oct 30 14:21:07 user nova-compute[74319]:     <apic/>
Oct 30 14:21:07 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:21:07 user nova-compute[74319]:   </features>
Oct 30 14:21:07 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:21:07 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:21:07 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:21:07 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:21:07 user nova-compute[74319]:   </clock>
Oct 30 14:21:07 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:21:07 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:21:07 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:21:07 user nova-compute[74319]:   </cpu>
Oct 30 14:21:07 user nova-compute[74319]:   <devices>
Oct 30 14:21:07 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:21:07 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:21:07 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk"/>
Oct 30 14:21:07 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:21:07 user nova-compute[74319]:     </disk>
Oct 30 14:21:07 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:21:07 user nova-compute[74319]:       <mac address="fa:16:3e:96:7b:26"/>
Oct 30 14:21:07 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:21:07 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:21:07 user nova-compute[74319]:       <target dev="tap96f2bacd-f5"/>
Oct 30 14:21:07 user nova-compute[74319]:     </interface>
Oct 30 14:21:07 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:21:07 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/console.log" append="off"/>
Oct 30 14:21:07 user nova-compute[74319]:     </serial>
Oct 30 14:21:07 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:21:07 user nova-compute[74319]:     <video>
Oct 30 14:21:07 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:21:07 user nova-compute[74319]:     </video>
Oct 30 14:21:07 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:21:07 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:21:07 user nova-compute[74319]:     </rng>
Oct 30 14:21:07 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:21:07 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:21:07 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:21:07 user nova-compute[74319]:     </memballoon>
Oct 30 14:21:07 user nova-compute[74319]:   </devices>
Oct 30 14:21:07 user nova-compute[74319]: </domain>
Oct 30 14:21:07 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477593427',display_name='tempest-ServerRescueNegativeTestJSON-server-1477593427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477593427',id=38,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-xvk1f5n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:05Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9069a745-a232-47f6-b6a3-cde3ba8c8afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG os_vif [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dbce21bd-dff1-57f5-8a72-2937019f52f7', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f2bacd-f5, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96f2bacd-f5, col_values=(('qos', UUID('6031555c-5b1e-4e71-a8c1-151595dd0912')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96f2bacd-f5, col_values=(('external_ids', {'iface-id': '96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:7b:26', 'vm-uuid': '9069a745-a232-47f6-b6a3-cde3ba8c8afb'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: INFO os_vif [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5')
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:96:7b:26, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-changed-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Refreshing instance network info cache due to event network-changed-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Refreshing network info cache for port 96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:08 user nova-compute[74319]: WARNING nova.compute.manager [req-1e7dc508-a170-4364-bc1c-03b553aa4feb req-de28f18c-76a0-4711-9908-30f894910c2d service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state building and task_state spawning.
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updated VIF entry in instance network info cache for port 96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bcbded0e-62db-49dc-89fa-1e8eb4a62623 req-767afa6d-01ca-4d0e-970f-b3e187ddf956 service nova] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:21:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:10 user nova-compute[74319]: WARNING nova.compute.manager [req-ed7da422-60aa-4c29-a314-32a69e35f4df req-f90db4eb-eafe-4295-a56a-8c06733329ce service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state building and task_state spawning.
Oct 30 14:21:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:10 user nova-compute[74319]: WARNING nova.compute.manager [req-a8dc8293-9712-4616-970a-a8079abc50df req-d4b2678c-c5e2-40a4-8bc7-a8a167218f10 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state building and task_state spawning.
Oct 30 14:21:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance spawned successfully.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Took 7.93 seconds to spawn the instance on the hypervisor.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.compute.manager [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Took 8.53 seconds to build instance.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-90b0e4b6-9f6f-42f3-9ad4-c4d882b350b5 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.628s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:12 user nova-compute[74319]: WARNING nova.compute.manager [req-2c1d4c85-a97c-4b96-b968-0519fd58b5c6 req-12e9855b-8c49-41ff-b4d0-4bbef96c2736 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state building and task_state spawning.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance spawned successfully.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Took 7.34 seconds to spawn the instance on the hypervisor.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:21:12 user nova-compute[74319]: INFO nova.compute.manager [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Took 8.03 seconds to build instance.
Oct 30 14:21:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2c8d1bb7-00cf-4eb4-a8b6-7967c1a96f93 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.149s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:24 user nova-compute[74319]: INFO nova.compute.manager [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Terminating instance
Oct 30 14:21:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-unplugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] No waiting events found dispatching network-vif-unplugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-fa2b73f4-4317-4ea5-b177-fc09c0bb328a req-6628bfde-0e40-4571-90a5-f4af02327cf7 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-unplugged-e2267563-7015-4437-b8dd-eea233e1f0a1 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:21:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Instance destroyed successfully.
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.objects.instance [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lazy-loading 'resources' on Instance uuid 7ce4683d-18d7-47cb-9f2e-15a53c528d82 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1483966066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1483966066',id=15,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:01:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='40f2668e6b874840ad286ca9a8189fd4',ramdisk_id='',reservation_id='r-mhtlp2be',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-572655155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:02:53Z,user_data=None,user_id='a708010243464fe9bbf96c2e0e79a0dd',uuid=7ce4683d-18d7-47cb-9f2e-15a53c528d82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converting VIF {"id": "e2267563-7015-4437-b8dd-eea233e1f0a1", "address": "fa:16:3e:b6:64:0d", "network": {"id": "7871fd89-ba7f-4efd-99f8-4e5bd448ba37", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-790131132-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "40f2668e6b874840ad286ca9a8189fd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2267563-70", "ovs_interfaceid": "e2267563-7015-4437-b8dd-eea233e1f0a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG os_vif [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2267563-70, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b9ff2ee-333f-4312-98c0-bbc74b409ce4) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:25 user nova-compute[74319]: INFO os_vif [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:64:0d,bridge_name='br-int',has_traffic_filtering=True,id=e2267563-7015-4437-b8dd-eea233e1f0a1,network=Network(7871fd89-ba7f-4efd-99f8-4e5bd448ba37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2267563-70')
Oct 30 14:21:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Deleting instance files /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82_del
Oct 30 14:21:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Deletion of /opt/stack/data/nova/instances/7ce4683d-18d7-47cb-9f2e-15a53c528d82_del complete
Oct 30 14:21:25 user nova-compute[74319]: INFO nova.compute.manager [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 30 14:21:25 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:21:25 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:21:26 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:26 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Took 0.58 seconds to deallocate network for instance.
Oct 30 14:21:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:26 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:21:26 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:21:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:26 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Deleted allocations for instance 7ce4683d-18d7-47cb-9f2e-15a53c528d82
Oct 30 14:21:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-00e1d31c-c648-4a5b-9cc7-30b4320172e1 tempest-ServerBootFromVolumeStableRescueTest-572655155 tempest-ServerBootFromVolumeStableRescueTest-572655155-project-member] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.948s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] Acquiring lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] Lock "7ce4683d-18d7-47cb-9f2e-15a53c528d82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] No waiting events found dispatching network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:27 user nova-compute[74319]: WARNING nova.compute.manager [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received unexpected event network-vif-plugged-e2267563-7015-4437-b8dd-eea233e1f0a1 for instance with vm_state deleted and task_state None.
Oct 30 14:21:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-e23e25b2-0c67-401a-b4bd-85f694d45d85 req-d4c7f716-659f-4147-96ea-8ba582824a32 service nova] [instance: 7ce4683d-18d7-47cb-9f2e-15a53c528d82] Received event network-vif-deleted-e2267563-7015-4437-b8dd-eea233e1f0a1 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:36 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:36 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:36 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:21:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8460MB free_disk=25.232315063476562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 415ca70b-eb7b-484d-925e-14fbd8980d7a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:21:38 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:21:39 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:21:39 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:21:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:21:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.615s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:21:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:21:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:21:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:21:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:57 user nova-compute[74319]: INFO nova.compute.manager [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Terminating instance
Oct 30 14:21:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Instance destroyed successfully.
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lazy-loading 'resources' on Instance uuid 415ca70b-eb7b-484d-925e-14fbd8980d7a {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1879111475',display_name='tempest-AttachVolumeTestJSON-server-1879111475',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1879111475',id=35,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDx27VfNFLMf0o7OBVOQnK2oWewL2tH+dLxKEnA3ipqP282olGvdXIPYLnZRgkFTs/mHWYnWT0xHVlxYDFXLMGwWycpk/f78kd+e9DWNOrdyT7ULeXAzCoUGdhyw4pb/Q==',key_name='tempest-keypair-534718999',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:16:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42370e22b20540a6b4670bfcc02d62b6',ramdisk_id='',reservation_id='r-ncp4oqbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-636845633',owner_user_name='tempest-AttachVolumeTestJSON-636845633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:16:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='521f59eb12f844b49a6a727ec38bd016',uuid=415ca70b-eb7b-484d-925e-14fbd8980d7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converting VIF {"id": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "address": "fa:16:3e:3c:fc:92", "network": {"id": "b0be6be0-740c-4330-9730-eba566df62c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-840632675-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "42370e22b20540a6b4670bfcc02d62b6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fe89742-49", "ovs_interfaceid": "4fe89742-4979-4ec5-acc1-9b926bb88cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG os_vif [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fe89742-49, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d84b15c-306b-426b-8bf4-9a2b6ad701e7) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:21:58 user nova-compute[74319]: INFO os_vif [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=4fe89742-4979-4ec5-acc1-9b926bb88cb9,network=Network(b0be6be0-740c-4330-9730-eba566df62c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fe89742-49')
Oct 30 14:21:58 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Deleting instance files /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a_del
Oct 30 14:21:58 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Deletion of /opt/stack/data/nova/instances/415ca70b-eb7b-484d-925e-14fbd8980d7a_del complete
Oct 30 14:21:58 user nova-compute[74319]: INFO nova.compute.manager [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 30 14:21:58 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-unplugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] No waiting events found dispatching network-vif-unplugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-8571de4c-3609-4126-9970-4645f342c9e7 req-38b16753-3515-4a2f-a188-e56d5c24d550 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-unplugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:21:59 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Took 1.07 seconds to deallocate network for instance.
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:21:59 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Deleted allocations for instance 415ca70b-eb7b-484d-925e-14fbd8980d7a
Oct 30 14:21:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-2ef4585a-fc73-430b-93f2-21518ec91b2a tempest-AttachVolumeTestJSON-636845633 tempest-AttachVolumeTestJSON-636845633-project-member] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.503s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] Acquiring lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] Lock "415ca70b-eb7b-484d-925e-14fbd8980d7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] No waiting events found dispatching network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:01 user nova-compute[74319]: WARNING nova.compute.manager [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received unexpected event network-vif-plugged-4fe89742-4979-4ec5-acc1-9b926bb88cb9 for instance with vm_state deleted and task_state None.
Oct 30 14:22:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-cc617f12-2d91-44a1-8033-03980ff1a821 req-f0a918ec-8379-474b-ad5e-8510b07ed604 service nova] [instance: 415ca70b-eb7b-484d-925e-14fbd8980d7a] Received event network-vif-deleted-4fe89742-4979-4ec5-acc1-9b926bb88cb9 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:22:04 user nova-compute[74319]: INFO nova.compute.claims [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Claim successful on node user
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:22:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.policy [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '63b5a0856f194976b1920f181cd9b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c203715ae9984113b55404207018baaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:22:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Creating image(s)
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "/opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "/opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.168s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.190s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk 1073741824" returned: 0 in 0.063s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Successfully created port: f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Cannot resize image /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Ensure instance console log exists: /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Successfully updated port: f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-changed-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Refreshing instance network info cache due to event network-changed-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] Acquiring lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] Acquired lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Refreshing network info cache for port f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-42e3b496-ba39-406d-a98d-6a1710dabfe3 req-b7c44c65-3261-4ace-81f0-0c70f5b1d87a service nova] Releasing lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquired lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Releasing lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance network_info: |[{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Start _get_guest_xml network_info=[{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:22:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465075480',display_name='tempest-SnapshotDataIntegrityTests-server-465075480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465075480',id=39,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ2IrHagMeW1hLB/a3XxRMh+05fwroH4D8bnyDrqbm1EPjJAqyPLTMcKB501XQjuWbH9MEZeBnqz9/UScTR+6cePe9YEX2tQ24D/PquLfU/dqWwjvbRkUJd2TAWDQnlkQ==',key_name='tempest-keypair-176585519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c203715ae9984113b55404207018baaf',ramdisk_id='',reservation_id='r-yo4155ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1972941964',owner_user_name='tempest-SnapshotDataIntegrityTests-1972941964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b5a0856f194976b1920f181cd9b3e4',uuid=ce424e4a-8971-4b85-be63-3a74a34916b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converting VIF {"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'pci_devices' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:22:06 user nova-compute[74319]:   <uuid>ce424e4a-8971-4b85-be63-3a74a34916b1</uuid>
Oct 30 14:22:06 user nova-compute[74319]:   <name>instance-00000027</name>
Oct 30 14:22:06 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:22:06 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:22:06 user nova-compute[74319]:   <metadata>
Oct 30 14:22:06 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:22:06 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-465075480</nova:name>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:22:06</nova:creationTime>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:22:06 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:22:06 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:owner>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:user uuid="63b5a0856f194976b1920f181cd9b3e4">tempest-SnapshotDataIntegrityTests-1972941964-project-member</nova:user>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:project uuid="c203715ae9984113b55404207018baaf">tempest-SnapshotDataIntegrityTests-1972941964</nova:project>
Oct 30 14:22:06 user nova-compute[74319]:       </nova:owner>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:22:06 user nova-compute[74319]:       <nova:ports>
Oct 30 14:22:06 user nova-compute[74319]:         <nova:port uuid="f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d">
Oct 30 14:22:06 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 14:22:06 user nova-compute[74319]:         </nova:port>
Oct 30 14:22:06 user nova-compute[74319]:       </nova:ports>
Oct 30 14:22:06 user nova-compute[74319]:     </nova:instance>
Oct 30 14:22:06 user nova-compute[74319]:   </metadata>
Oct 30 14:22:06 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:22:06 user nova-compute[74319]:     <system>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="serial">ce424e4a-8971-4b85-be63-3a74a34916b1</entry>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="uuid">ce424e4a-8971-4b85-be63-3a74a34916b1</entry>
Oct 30 14:22:06 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:22:06 user nova-compute[74319]:     </system>
Oct 30 14:22:06 user nova-compute[74319]:   </sysinfo>
Oct 30 14:22:06 user nova-compute[74319]:   <os>
Oct 30 14:22:06 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:22:06 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:22:06 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:22:06 user nova-compute[74319]:   </os>
Oct 30 14:22:06 user nova-compute[74319]:   <features>
Oct 30 14:22:06 user nova-compute[74319]:     <acpi/>
Oct 30 14:22:06 user nova-compute[74319]:     <apic/>
Oct 30 14:22:06 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:22:06 user nova-compute[74319]:   </features>
Oct 30 14:22:06 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:22:06 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:22:06 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:22:06 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:22:06 user nova-compute[74319]:   </clock>
Oct 30 14:22:06 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:22:06 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:22:06 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:22:06 user nova-compute[74319]:   </cpu>
Oct 30 14:22:06 user nova-compute[74319]:   <devices>
Oct 30 14:22:06 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:22:06 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:22:06 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk"/>
Oct 30 14:22:06 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:22:06 user nova-compute[74319]:     </disk>
Oct 30 14:22:06 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:22:06 user nova-compute[74319]:       <mac address="fa:16:3e:23:06:a5"/>
Oct 30 14:22:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:22:06 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:22:06 user nova-compute[74319]:       <target dev="tapf4afe8ef-b0"/>
Oct 30 14:22:06 user nova-compute[74319]:     </interface>
Oct 30 14:22:06 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:22:06 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/console.log" append="off"/>
Oct 30 14:22:06 user nova-compute[74319]:     </serial>
Oct 30 14:22:06 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:22:06 user nova-compute[74319]:     <video>
Oct 30 14:22:06 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:22:06 user nova-compute[74319]:     </video>
Oct 30 14:22:06 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:22:06 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:22:06 user nova-compute[74319]:     </rng>
Oct 30 14:22:06 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:22:06 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:22:06 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:22:06 user nova-compute[74319]:     </memballoon>
Oct 30 14:22:06 user nova-compute[74319]:   </devices>
Oct 30 14:22:06 user nova-compute[74319]: </domain>
Oct 30 14:22:06 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465075480',display_name='tempest-SnapshotDataIntegrityTests-server-465075480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465075480',id=39,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ2IrHagMeW1hLB/a3XxRMh+05fwroH4D8bnyDrqbm1EPjJAqyPLTMcKB501XQjuWbH9MEZeBnqz9/UScTR+6cePe9YEX2tQ24D/PquLfU/dqWwjvbRkUJd2TAWDQnlkQ==',key_name='tempest-keypair-176585519',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c203715ae9984113b55404207018baaf',ramdisk_id='',reservation_id='r-yo4155ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1972941964',owner_user_name='tempest-SnapshotDataIntegrityTests-1972941964-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b5a0856f194976b1920f181cd9b3e4',uuid=ce424e4a-8971-4b85-be63-3a74a34916b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converting VIF {"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG os_vif [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51b73c95-ab5c-51ce-a453-024362940a45', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4afe8ef-b0, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4afe8ef-b0, col_values=(('qos', UUID('ebee6c45-03f5-4fee-96e1-347d903155e8')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4afe8ef-b0, col_values=(('external_ids', {'iface-id': 'f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:06:a5', 'vm-uuid': 'ce424e4a-8971-4b85-be63-3a74a34916b1'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:06 user nova-compute[74319]: INFO os_vif [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0')
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:22:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No VIF found with MAC fa:16:3e:23:06:a5, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:08 user nova-compute[74319]: WARNING nova.compute.manager [req-07fd0ced-621d-454a-b7de-c400e051df0f req-6eac7e30-66c8-425e-8d50-51e7bc50d3b6 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state building and task_state spawning.
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:10 user nova-compute[74319]: WARNING nova.compute.manager [req-1da0bd56-b66a-4f6d-b2c8-85dd73413a5c req-23342470-c6ea-4b0c-bba6-da797d77118b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state building and task_state spawning.
Oct 30 14:22:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:22:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:22:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance spawned successfully.
Oct 30 14:22:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:22:11 user nova-compute[74319]: INFO nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Took 6.45 seconds to spawn the instance on the hypervisor.
Oct 30 14:22:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:22:11 user nova-compute[74319]: INFO nova.compute.manager [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Took 7.05 seconds to build instance.
Oct 30 14:22:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4f6c8a0a-a4dd-4058-87a2-77c0d56b986f tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.169s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:40 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8518MB free_disk=25.21135711669922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:22:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.302s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:22:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:22:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:22:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:22:55 user nova-compute[74319]: INFO nova.compute.manager [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Rescuing
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:55 user nova-compute[74319]: WARNING nova.compute.manager [req-08704c4c-1d4d-436a-8248-c1023e4a0a36 req-935b1d31-23bd-405d-845f-28db52c144bb service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state active and task_state rescuing.
Oct 30 14:22:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance destroyed successfully.
Oct 30 14:22:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Attempting rescue
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:22:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Creating image(s)
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.203s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue" returned: 0 in 0.054s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'migration_context' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9069a745-a232-47f6-b6a3-cde3ba8c8afb> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start _get_guest_xml network_info=[{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:96:7b:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e84464e-b827-48f1-88b9-f2140e869651', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9069a745-a232-47f6-b6a3-cde3ba8c8afb> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'numa_topology' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9069a745-a232-47f6-b6a3-cde3ba8c8afb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:22:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9069a745-a232-47f6-b6a3-cde3ba8c8afb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477593427',display_name='tempest-ServerRescueNegativeTestJSON-server-1477593427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477593427',id=38,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-xvk1f5n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:13Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9069a745-a232-47f6-b6a3-cde3ba8c8afb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:96:7b:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:96:7b:26"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9069a745-a232-47f6-b6a3-cde3ba8c8afb> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:22:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:22:56 user nova-compute[74319]:   <uuid>9069a745-a232-47f6-b6a3-cde3ba8c8afb</uuid>
Oct 30 14:22:56 user nova-compute[74319]:   <name>instance-00000026</name>
Oct 30 14:22:56 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:22:56 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:22:56 user nova-compute[74319]:   <metadata>
Oct 30 14:22:56 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:22:56 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1477593427</nova:name>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:22:56</nova:creationTime>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:22:56 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:22:56 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:owner>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:22:56 user nova-compute[74319]:       </nova:owner>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:22:56 user nova-compute[74319]:       <nova:ports>
Oct 30 14:22:56 user nova-compute[74319]:         <nova:port uuid="96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d">
Oct 30 14:22:56 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:22:56 user nova-compute[74319]:         </nova:port>
Oct 30 14:22:56 user nova-compute[74319]:       </nova:ports>
Oct 30 14:22:56 user nova-compute[74319]:     </nova:instance>
Oct 30 14:22:56 user nova-compute[74319]:   </metadata>
Oct 30 14:22:56 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:22:56 user nova-compute[74319]:     <system>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="serial">9069a745-a232-47f6-b6a3-cde3ba8c8afb</entry>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="uuid">9069a745-a232-47f6-b6a3-cde3ba8c8afb</entry>
Oct 30 14:22:56 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:22:56 user nova-compute[74319]:     </system>
Oct 30 14:22:56 user nova-compute[74319]:   </sysinfo>
Oct 30 14:22:56 user nova-compute[74319]:   <os>
Oct 30 14:22:56 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:22:56 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:22:56 user nova-compute[74319]:   </os>
Oct 30 14:22:56 user nova-compute[74319]:   <features>
Oct 30 14:22:56 user nova-compute[74319]:     <acpi/>
Oct 30 14:22:56 user nova-compute[74319]:     <apic/>
Oct 30 14:22:56 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:22:56 user nova-compute[74319]:   </features>
Oct 30 14:22:56 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:22:56 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:22:56 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:22:56 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:22:56 user nova-compute[74319]:   </clock>
Oct 30 14:22:56 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:22:56 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:22:56 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:22:56 user nova-compute[74319]:   </cpu>
Oct 30 14:22:56 user nova-compute[74319]:   <devices>
Oct 30 14:22:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:22:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:22:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue"/>
Oct 30 14:22:56 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:22:56 user nova-compute[74319]:     </disk>
Oct 30 14:22:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:22:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:22:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk"/>
Oct 30 14:22:56 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:22:56 user nova-compute[74319]:     </disk>
Oct 30 14:22:56 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:22:56 user nova-compute[74319]:       <mac address="fa:16:3e:96:7b:26"/>
Oct 30 14:22:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:22:56 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:22:56 user nova-compute[74319]:       <target dev="tap96f2bacd-f5"/>
Oct 30 14:22:56 user nova-compute[74319]:     </interface>
Oct 30 14:22:56 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:22:56 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/console.log" append="off"/>
Oct 30 14:22:56 user nova-compute[74319]:     </serial>
Oct 30 14:22:56 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:22:56 user nova-compute[74319]:     <video>
Oct 30 14:22:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:22:56 user nova-compute[74319]:     </video>
Oct 30 14:22:56 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:22:56 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:22:56 user nova-compute[74319]:     </rng>
Oct 30 14:22:56 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:22:56 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:22:56 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:22:56 user nova-compute[74319]:     </memballoon>
Oct 30 14:22:56 user nova-compute[74319]:   </devices>
Oct 30 14:22:56 user nova-compute[74319]: </domain>
Oct 30 14:22:56 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:22:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance destroyed successfully.
Oct 30 14:22:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:96:7b:26, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:57 user nova-compute[74319]: WARNING nova.compute.manager [req-dfc9d3ed-7d34-44bf-bc08-832f55d96d6f req-7edfbe5d-1cf9-4d67-831d-64efa9386287 service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state active and task_state rescuing.
Oct 30 14:22:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:59 user nova-compute[74319]: WARNING nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state active and task_state rescuing.
Oct 30 14:22:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:22:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:22:59 user nova-compute[74319]: WARNING nova.compute.manager [req-a2470e27-665d-4ecb-b49e-abb28ddaca1e req-fc15009f-e9dd-4e11-96e8-c4fc17c136bc service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state active and task_state rescuing.
Oct 30 14:23:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-633218e0-e481-458c-8cd1-f19057b3bf71 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:23:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:38 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:23:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:23:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:23:38 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:23:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:23:41 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:23:41 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8575MB free_disk=25.197101593017578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:23:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:23:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:50 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:23:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:23:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:23:51 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:23:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:23:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:23:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:23:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:23:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-changed-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:23:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Refreshing instance network info cache due to event network-changed-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:23:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] Acquiring lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:23:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] Acquired lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:23:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Refreshing network info cache for port f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:23:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updated VIF entry in instance network info cache for port f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:23:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:23:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-13b7a568-ec04-4844-a0df-cd3bfcf6fc43 req-048f0552-e759-41ac-9628-fb2374c94c94 service nova] Releasing lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:23:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:23:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:01 user nova-compute[74319]: DEBUG nova.objects.instance [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:02 user nova-compute[74319]: INFO nova.compute.manager [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attaching volume 66eab245-b7a6-465a-a71f-c357f209012d to /dev/vdb
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.utils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb981f1-f380-47af-bf36-16fd9023185f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d39a11-0410-4ea8-a3cc-65ee76ea955c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d3b38-d7d4-4eea-9e31-7feebbb24015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34d9c78-11fa-4180-b687-9641608a8ca5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:24:02 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:24:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1017b-64f2-4907-85f2-ba85ee324d81]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG os_brick.utils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:24:02 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating existing volume attachment record: 9045bfd4-6745-4518-b88e-ba14554203f5 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:24:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxXSmgUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:24:22 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:24:22 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:24:22 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab9b62-0e89-4688-929e-9bd3be93bd49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:24:22 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:24:22 user nova-compute[74319]: INFO nova.compute.claims [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Claim successful on node user
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3a80d5-f11a-413e-930f-a71e1ba06a31]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d] added
Oct 30 14:24:22 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e4297-1bd1-4661-b3ba-ec3dec194dcb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e8a0c0-8336-4660-8b6d-15d1bd125bfe]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxXSmgUB {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RxXSmgUB" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[069b99c2-ed43-47c9-b641-4502acf1b1dc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RxXSmgUB'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d116129-c847-4b9c-ae9b-92f83f0093bb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4296fef6-c9fe-45e4-a688-26ffe35dae83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:24:23 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:24:23 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:24:23 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:24:23 user nova-compute[74319]: 
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b1855d-6361-48f3-86fa-d9a4b7b83e9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260]
Oct 30 14:24:23 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260] successful.
Oct 30 14:24:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c083c8e8-0d91-4720-a6b3-4a364e84f5e8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e38a7e2-6a49-4538-a7b7-c52d369a40bf]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:24:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:24:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f19fe2-dd57-49fe-83dc-520878c44346]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxXSmgUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.332s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:24:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.policy [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd3b003ba8714cdb92097d33bfa3adee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188dfdda98fd44e4aefdba73b0de9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:24:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Creating image(s)
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "/opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "/opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "/opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk 1073741824" returned: 0 in 0.054s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Successfully created port: aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.218s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '26536623536346162', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536623536346162', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.objects.instance [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:24:24 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:24:24 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:24:24 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:24:24 user nova-compute[74319]:   <serial>66eab245-b7a6-465a-a71f-c357f209012d</serial>
Oct 30 14:24:24 user nova-compute[74319]: </disk>
Oct 30 14:24:24 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Cannot resize image /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Ensure instance console log exists: /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No VIF found with MAC fa:16:3e:23:06:a5, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Successfully updated port: aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquired lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-changed-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Refreshing instance network info cache due to event network-changed-aa923db7-42a3-482f-98a5-0367bf215f58. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] Acquiring lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:24:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-261d586e-e6fb-49da-90c9-67c8136c1b4d tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.564s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Updating instance_info_cache with network_info: [{"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Releasing lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Instance network_info: |[{"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] Acquired lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.neutron [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Refreshing network info cache for port aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Start _get_guest_xml network_info=[{"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:24:25 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:24:25 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1943968478',display_name='tempest-VolumesActionsTest-instance-1943968478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1943968478',id=40,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-ggw12y6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:24:23Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=baf66f82-c21a-4abb-8b37-765b8a115f9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lazy-loading 'pci_devices' on Instance uuid baf66f82-c21a-4abb-8b37-765b8a115f9f {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:24:25 user nova-compute[74319]:   <uuid>baf66f82-c21a-4abb-8b37-765b8a115f9f</uuid>
Oct 30 14:24:25 user nova-compute[74319]:   <name>instance-00000028</name>
Oct 30 14:24:25 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:24:25 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:24:25 user nova-compute[74319]:   <metadata>
Oct 30 14:24:25 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:24:25 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:name>tempest-VolumesActionsTest-instance-1943968478</nova:name>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:24:25</nova:creationTime>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:24:25 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:24:25 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:owner>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:user uuid="dd3b003ba8714cdb92097d33bfa3adee">tempest-VolumesActionsTest-2066604202-project-member</nova:user>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:project uuid="188dfdda98fd44e4aefdba73b0de9615">tempest-VolumesActionsTest-2066604202</nova:project>
Oct 30 14:24:25 user nova-compute[74319]:       </nova:owner>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:24:25 user nova-compute[74319]:       <nova:ports>
Oct 30 14:24:25 user nova-compute[74319]:         <nova:port uuid="aa923db7-42a3-482f-98a5-0367bf215f58">
Oct 30 14:24:25 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:24:25 user nova-compute[74319]:         </nova:port>
Oct 30 14:24:25 user nova-compute[74319]:       </nova:ports>
Oct 30 14:24:25 user nova-compute[74319]:     </nova:instance>
Oct 30 14:24:25 user nova-compute[74319]:   </metadata>
Oct 30 14:24:25 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:24:25 user nova-compute[74319]:     <system>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="serial">baf66f82-c21a-4abb-8b37-765b8a115f9f</entry>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="uuid">baf66f82-c21a-4abb-8b37-765b8a115f9f</entry>
Oct 30 14:24:25 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:24:25 user nova-compute[74319]:     </system>
Oct 30 14:24:25 user nova-compute[74319]:   </sysinfo>
Oct 30 14:24:25 user nova-compute[74319]:   <os>
Oct 30 14:24:25 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:24:25 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:24:25 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:24:25 user nova-compute[74319]:   </os>
Oct 30 14:24:25 user nova-compute[74319]:   <features>
Oct 30 14:24:25 user nova-compute[74319]:     <acpi/>
Oct 30 14:24:25 user nova-compute[74319]:     <apic/>
Oct 30 14:24:25 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:24:25 user nova-compute[74319]:   </features>
Oct 30 14:24:25 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:24:25 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:24:25 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:24:25 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:24:25 user nova-compute[74319]:   </clock>
Oct 30 14:24:25 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:24:25 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:24:25 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:24:25 user nova-compute[74319]:   </cpu>
Oct 30 14:24:25 user nova-compute[74319]:   <devices>
Oct 30 14:24:25 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:24:25 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:24:25 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk"/>
Oct 30 14:24:25 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:24:25 user nova-compute[74319]:     </disk>
Oct 30 14:24:25 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:24:25 user nova-compute[74319]:       <mac address="fa:16:3e:5a:45:9e"/>
Oct 30 14:24:25 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:24:25 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:24:25 user nova-compute[74319]:       <target dev="tapaa923db7-42"/>
Oct 30 14:24:25 user nova-compute[74319]:     </interface>
Oct 30 14:24:25 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:24:25 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/console.log" append="off"/>
Oct 30 14:24:25 user nova-compute[74319]:     </serial>
Oct 30 14:24:25 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:24:25 user nova-compute[74319]:     <video>
Oct 30 14:24:25 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:24:25 user nova-compute[74319]:     </video>
Oct 30 14:24:25 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:24:25 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:24:25 user nova-compute[74319]:     </rng>
Oct 30 14:24:25 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:24:25 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:24:25 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:24:25 user nova-compute[74319]:     </memballoon>
Oct 30 14:24:25 user nova-compute[74319]:   </devices>
Oct 30 14:24:25 user nova-compute[74319]: </domain>
Oct 30 14:24:25 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1943968478',display_name='tempest-VolumesActionsTest-instance-1943968478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1943968478',id=40,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-ggw12y6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:24:23Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=baf66f82-c21a-4abb-8b37-765b8a115f9f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG os_vif [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '584e2cb7-b9fe-59d7-8927-c00e9dab7893', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa923db7-42, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa923db7-42, col_values=(('qos', UUID('73807655-c3d0-42ee-8b52-c4c157e68a0b')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa923db7-42, col_values=(('external_ids', {'iface-id': 'aa923db7-42a3-482f-98a5-0367bf215f58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:45:9e', 'vm-uuid': 'baf66f82-c21a-4abb-8b37-765b8a115f9f'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:25 user nova-compute[74319]: INFO os_vif [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42')
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] No VIF found with MAC fa:16:3e:5a:45:9e, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.neutron [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Updated VIF entry in instance network info cache for port aa923db7-42a3-482f-98a5-0367bf215f58. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG nova.network.neutron [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Updating instance_info_cache with network_info: [{"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88909fa4-9b90-436f-86d6-37dd6bf1bad2 req-f5e0442c-1c56-4807-b44d-6a7913da5404 service nova] Releasing lock "refresh_cache-baf66f82-c21a-4abb-8b37-765b8a115f9f" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] No waiting events found dispatching network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:24:26 user nova-compute[74319]: WARNING nova.compute.manager [req-8c6c254f-df5b-4fe7-9896-0c6d22799a13 req-14666e86-dfc9-42c8-881c-1b4ac6bc3b1f service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received unexpected event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 for instance with vm_state building and task_state spawning.
Oct 30 14:24:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:24:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Instance spawned successfully.
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:24:28 user nova-compute[74319]: INFO nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Took 5.41 seconds to spawn the instance on the hypervisor.
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] No waiting events found dispatching network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:24:28 user nova-compute[74319]: WARNING nova.compute.manager [req-27371c42-4bf7-4037-a509-b9568b3cc367 req-cda097f3-06b4-4fb3-bda5-432da0dcd2a7 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received unexpected event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 for instance with vm_state building and task_state spawning.
Oct 30 14:24:28 user nova-compute[74319]: INFO nova.compute.manager [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Took 6.09 seconds to build instance.
Oct 30 14:24:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7595596c-f8ed-45f1-9451-66ed7c218bba tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.191s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:40 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:41 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:24:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:24:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8444MB free_disk=25.183425903320312GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance baf66f82-c21a-4abb-8b37-765b8a115f9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:24:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:44 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:47 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:24:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:24:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:24:55 user nova-compute[74319]: INFO nova.compute.claims [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Claim successful on node user
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:24:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:24:55 user nova-compute[74319]: DEBUG nova.policy [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:24:55 user nova-compute[74319]: INFO nova.virt.block_device [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Booting with volume snapshot 73cb41b0-53a9-42d0-aa4b-d59de238f5bf at /dev/vda
Oct 30 14:24:56 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Successfully created port: 0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:24:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Successfully updated port: 0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-changed-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Refreshing instance network info cache due to event network-changed-0352c6ba-ae56-41d3-87b9-826bf88d220e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] Acquiring lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Updating instance_info_cache with network_info: [{"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Instance network_info: |[{"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] Acquired lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:24:57 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Refreshing network info cache for port 0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:24:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Updated VIF entry in instance network info cache for port 0352c6ba-ae56-41d3-87b9-826bf88d220e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:24:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Updating instance_info_cache with network_info: [{"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:24:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e7d6c750-53d3-495c-ab0a-71db65a40654 req-0468eb5a-c361-433d-9b1c-bcf67fb300c3 service nova] Releasing lock "refresh_cache-d34934a1-9699-47a4-9ace-6399d8c2bbd1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:25:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df65c157-827d-4269-8493-fef3167750f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f7ffa-6242-44a1-aab9-02be5fb971b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1567b6-9422-41a4-846e-205c94ef029c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[636caa10-86e2-45bf-ba06-c2d466dd48e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:25:01 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:25:01 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f8c9f-4ef6-4903-8410-dbdbbbce1898]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG os_brick.utils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:25:01 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Updating existing volume attachment record: 959fba0e-6857-470b-a243-2547708422a0 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:25:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:03 user nova-compute[74319]: INFO nova.compute.manager [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Detaching volume 66eab245-b7a6-465a-a71f-c357f209012d
Oct 30 14:25:03 user nova-compute[74319]: INFO nova.virt.block_device [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attempting to driver detach volume 66eab245-b7a6-465a-a71f-c357f209012d from mountpoint /dev/vdb
Oct 30 14:25:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Attempting to detach device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:25:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:25:03 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:25:03 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:25:03 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:25:03 user nova-compute[74319]:   <serial>66eab245-b7a6-465a-a71f-c357f209012d</serial>
Oct 30 14:25:03 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:25:03 user nova-compute[74319]: </disk>
Oct 30 14:25:03 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:25:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config.
Oct 30 14:25:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:25:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:25:03 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:25:03 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:25:03 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:25:03 user nova-compute[74319]:   <serial>66eab245-b7a6-465a-a71f-c357f209012d</serial>
Oct 30 14:25:03 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:25:03 user nova-compute[74319]: </disk>
Oct 30 14:25:03 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:25:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:25:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:25:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:25:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Creating image(s)
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Ensure instance console log exists: /opt/stack/data/nova/instances/d34934a1-9699-47a4-9ace-6399d8c2bbd1/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Start _get_guest_xml network_info=[{"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '959fba0e-6857-470b-a243-2547708422a0', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRjUimbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd34934a1-9699-47a4-9ace-6399d8c2bbd1', 'attached_at': '', 'detached_at': '', 'volume_id': '0dfdfbec-1230-48ed-90c4-049effde497c', 'serial': '0dfdfbec-1230-48ed-90c4-049effde497c'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:25:21 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:21 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRjUimbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:25:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:25:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:25:21 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c564f9b1-b571-47b8-b6a0-558084567d9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:25:21 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bf607f-600c-4c1d-8642-ca4de2f53942]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c] added
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32c6ef1-a814-4542-8973-6a9f9ac85bfe]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87473be-9463-4f57-a2f9-f4e61806e02a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRjUimbB {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRjUimbB" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3dd3db-faf2-4edd-82a9-7acc080c59b9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRjUimbB'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab62ffa-e103-42d8-ba57-cdd92f885cb5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8bd22-b175-496d-be33-e21eda94e69e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[61644cc8-5c78-4295-a7b3-a8239e40fc68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260]
Oct 30 14:25:21 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260] successful.
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[868d3e90-2703-4bd3-98c9-9647c01b0995]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a595c0d-b69c-4de9-ab44-47bbe0f5c0e0]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:21 user nova-compute[74319]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:21 user nova-compute[74319]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:25:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[88745fd9-e2e6-4af5-947c-16ebc56e90a2]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:25:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRjUimbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23863636137316133', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863636137316133', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657637450',display_name='tempest-TestVolumeBootPattern-server-1657637450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657637450',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-d00v4rv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:24:56Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=d34934a1-9699-47a4-9ace-6399d8c2bbd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.objects.instance [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid d34934a1-9699-47a4-9ace-6399d8c2bbd1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:25:22 user nova-compute[74319]:   <uuid>d34934a1-9699-47a4-9ace-6399d8c2bbd1</uuid>
Oct 30 14:25:22 user nova-compute[74319]:   <name>instance-00000029</name>
Oct 30 14:25:22 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:25:22 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:25:22 user nova-compute[74319]:   <metadata>
Oct 30 14:25:22 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:25:22 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:25:22 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-server-1657637450</nova:name>
Oct 30 14:25:22 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:25:21</nova:creationTime>
Oct 30 14:25:22 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:25:22 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:25:22 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:25:22 user nova-compute[74319]:       <nova:owner>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:25:22 user nova-compute[74319]:       </nova:owner>
Oct 30 14:25:22 user nova-compute[74319]:       <nova:ports>
Oct 30 14:25:22 user nova-compute[74319]:         <nova:port uuid="0352c6ba-ae56-41d3-87b9-826bf88d220e">
Oct 30 14:25:22 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 14:25:22 user nova-compute[74319]:         </nova:port>
Oct 30 14:25:22 user nova-compute[74319]:       </nova:ports>
Oct 30 14:25:22 user nova-compute[74319]:     </nova:instance>
Oct 30 14:25:22 user nova-compute[74319]:   </metadata>
Oct 30 14:25:22 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:25:22 user nova-compute[74319]:     <system>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="serial">d34934a1-9699-47a4-9ace-6399d8c2bbd1</entry>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="uuid">d34934a1-9699-47a4-9ace-6399d8c2bbd1</entry>
Oct 30 14:25:22 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:25:22 user nova-compute[74319]:     </system>
Oct 30 14:25:22 user nova-compute[74319]:   </sysinfo>
Oct 30 14:25:22 user nova-compute[74319]:   <os>
Oct 30 14:25:22 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:25:22 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:25:22 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:25:22 user nova-compute[74319]:   </os>
Oct 30 14:25:22 user nova-compute[74319]:   <features>
Oct 30 14:25:22 user nova-compute[74319]:     <acpi/>
Oct 30 14:25:22 user nova-compute[74319]:     <apic/>
Oct 30 14:25:22 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:25:22 user nova-compute[74319]:   </features>
Oct 30 14:25:22 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:25:22 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:25:22 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:25:22 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:25:22 user nova-compute[74319]:   </clock>
Oct 30 14:25:22 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:25:22 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:25:22 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:25:22 user nova-compute[74319]:   </cpu>
Oct 30 14:25:22 user nova-compute[74319]:   <devices>
Oct 30 14:25:22 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:25:22 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:25:22 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:25:22 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:25:22 user nova-compute[74319]:       <serial>0dfdfbec-1230-48ed-90c4-049effde497c</serial>
Oct 30 14:25:22 user nova-compute[74319]:     </disk>
Oct 30 14:25:22 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:25:22 user nova-compute[74319]:       <mac address="fa:16:3e:14:08:e7"/>
Oct 30 14:25:22 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:25:22 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:25:22 user nova-compute[74319]:       <target dev="tap0352c6ba-ae"/>
Oct 30 14:25:22 user nova-compute[74319]:     </interface>
Oct 30 14:25:22 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:25:22 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/d34934a1-9699-47a4-9ace-6399d8c2bbd1/console.log" append="off"/>
Oct 30 14:25:22 user nova-compute[74319]:     </serial>
Oct 30 14:25:22 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:25:22 user nova-compute[74319]:     <video>
Oct 30 14:25:22 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:25:22 user nova-compute[74319]:     </video>
Oct 30 14:25:22 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:25:22 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:25:22 user nova-compute[74319]:     </rng>
Oct 30 14:25:22 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:25:22 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:25:22 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:25:22 user nova-compute[74319]:     </memballoon>
Oct 30 14:25:22 user nova-compute[74319]:   </devices>
Oct 30 14:25:22 user nova-compute[74319]: </domain>
Oct 30 14:25:22 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657637450',display_name='tempest-TestVolumeBootPattern-server-1657637450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657637450',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-d00v4rv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:24:56Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=d34934a1-9699-47a4-9ace-6399d8c2bbd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG os_vif [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0f8e46c-2a98-5633-b8be-e213372edd83', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0352c6ba-ae, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0352c6ba-ae, col_values=(('qos', UUID('12e4b166-54e3-419a-b2a0-927dc3bcfcd0')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0352c6ba-ae, col_values=(('external_ids', {'iface-id': '0352c6ba-ae56-41d3-87b9-826bf88d220e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:08:e7', 'vm-uuid': 'd34934a1-9699-47a4-9ace-6399d8c2bbd1'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:22 user nova-compute[74319]: INFO os_vif [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae')
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:25:22 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:14:08:e7, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:23 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 is timed out.
Oct 30 14:25:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config.
Oct 30 14:25:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxXSmgUB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:25:23 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d60e6-f0bd-48d9-b984-51c3ab357c35]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:25:23 user nova-compute[74319]: No targets found.
Oct 30 14:25:23 user nova-compute[74319]: iSNS:
Oct 30 14:25:23 user nova-compute[74319]: No targets found.
Oct 30 14:25:23 user nova-compute[74319]: STATIC:
Oct 30 14:25:23 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d
Oct 30 14:25:23 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:25:23 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:25:23 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c
Oct 30 14:25:23 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:25:23 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:25:23 user nova-compute[74319]: FIRMWARE:
Oct 30 14:25:23 user nova-compute[74319]: No targets found.
Oct 30 14:25:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:25:23 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:25:23 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c403ca-3694-4c99-b116-b6eb84533227]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe26a14-d081-4c3c-8bad-7d4440137ea6]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:24 user nova-compute[74319]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:25:24 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d (non-flash)
Oct 30 14:25:24 user nova-compute[74319]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:25:24 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974683d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb7c1b-211f-4feb-b275-454cc9af3ce8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[596283be-6b4e-47bf-ad90-a30490ea25fc]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[11181dfb-8282-49d8-b643-18844ff39a77]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG nova.compute.manager [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] No waiting events found dispatching network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:24 user nova-compute[74319]: WARNING nova.compute.manager [req-a9ddf627-2a34-4a40-a393-b7c9d75c5b54 req-8ea7a241-f27b-42f1-8e23-f2f961e95be7 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received unexpected event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e for instance with vm_state building and task_state spawning.
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.080s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e7203-981f-4683-932d-bef17302b1fa]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f23964d-955e-47eb-baa2-628790a6c26e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70413e5-8ad0-4ceb-8a61-4f025f3fb08d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260]
Oct 30 14:25:24 user nova-compute[74319]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d, portal: 172.16.0.220,3260] successful.
Oct 30 14:25:24 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:66eab245-b7a6-465a-a71f-c357f209012d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dade1f88-b0d7-4edc-b149-733fbf8c038f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== disconnect_volume: return (381ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:25 user nova-compute[74319]: DEBUG nova.objects.instance [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a8d6ce17-bb04-4f97-986b-9c98a18e6f1b tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.864s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:25:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:25:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Instance spawned successfully.
Oct 30 14:25:25 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:25:26 user nova-compute[74319]: INFO nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Took 4.92 seconds to spawn the instance on the hypervisor.
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:26 user nova-compute[74319]: DEBUG nova.compute.manager [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] No waiting events found dispatching network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:26 user nova-compute[74319]: WARNING nova.compute.manager [req-59205dc2-de15-4706-9e01-19b42ec8d8f2 req-56f89721-6310-4882-8282-841b18cd892f service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received unexpected event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e for instance with vm_state building and task_state spawning.
Oct 30 14:25:26 user nova-compute[74319]: INFO nova.compute.manager [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Took 30.76 seconds to build instance.
Oct 30 14:25:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-482cb768-bb2e-4f8c-8cbe-632bfbe52a6b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.871s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:41 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:42 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:45 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:45 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=25.15276336669922GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance baf66f82-c21a-4abb-8b37-765b8a115f9f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d34934a1-9699-47a4-9ace-6399d8c2bbd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:46 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:25:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:25:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:49 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:25:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:52 user nova-compute[74319]: INFO nova.compute.manager [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Rescuing
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:25:52 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:53 user nova-compute[74319]: WARNING nova.compute.manager [req-b9d1acc5-fb2b-4254-96b0-abcedbb22750 req-c56df2b2-b07a-4f5e-89ba-4552f5a3addb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state active and task_state rescuing.
Oct 30 14:25:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:25:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance destroyed successfully.
Oct 30 14:25:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Attempting rescue
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:25:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Creating image(s)
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.212s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue" returned: 0 in 0.053s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'migration_context' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9785d1bd-6e07-40a5-af8d-41eaf909759e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start _get_guest_xml network_info=[{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:ff:aa:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e84464e-b827-48f1-88b9-f2140e869651', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9785d1bd-6e07-40a5-af8d-41eaf909759e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'numa_topology' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9785d1bd-6e07-40a5-af8d-41eaf909759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:25:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9785d1bd-6e07-40a5-af8d-41eaf909759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-515377218',display_name='tempest-ServerRescueNegativeTestJSON-server-515377218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-515377218',id=37,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-0nkuezy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:21:12Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9785d1bd-6e07-40a5-af8d-41eaf909759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:ff:aa:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:ff:aa:7d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.objects.base [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<9785d1bd-6e07-40a5-af8d-41eaf909759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:25:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:25:53 user nova-compute[74319]:   <uuid>9785d1bd-6e07-40a5-af8d-41eaf909759e</uuid>
Oct 30 14:25:53 user nova-compute[74319]:   <name>instance-00000025</name>
Oct 30 14:25:53 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:25:53 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:25:53 user nova-compute[74319]:   <metadata>
Oct 30 14:25:53 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:25:53 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-515377218</nova:name>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:25:53</nova:creationTime>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:25:53 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:25:53 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:owner>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:25:53 user nova-compute[74319]:       </nova:owner>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:25:53 user nova-compute[74319]:       <nova:ports>
Oct 30 14:25:53 user nova-compute[74319]:         <nova:port uuid="f0aa1859-da9f-4143-8deb-6a8dbb3919cd">
Oct 30 14:25:53 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 30 14:25:53 user nova-compute[74319]:         </nova:port>
Oct 30 14:25:53 user nova-compute[74319]:       </nova:ports>
Oct 30 14:25:53 user nova-compute[74319]:     </nova:instance>
Oct 30 14:25:53 user nova-compute[74319]:   </metadata>
Oct 30 14:25:53 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:25:53 user nova-compute[74319]:     <system>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="serial">9785d1bd-6e07-40a5-af8d-41eaf909759e</entry>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="uuid">9785d1bd-6e07-40a5-af8d-41eaf909759e</entry>
Oct 30 14:25:53 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:25:53 user nova-compute[74319]:     </system>
Oct 30 14:25:53 user nova-compute[74319]:   </sysinfo>
Oct 30 14:25:53 user nova-compute[74319]:   <os>
Oct 30 14:25:53 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:25:53 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:25:53 user nova-compute[74319]:   </os>
Oct 30 14:25:53 user nova-compute[74319]:   <features>
Oct 30 14:25:53 user nova-compute[74319]:     <acpi/>
Oct 30 14:25:53 user nova-compute[74319]:     <apic/>
Oct 30 14:25:53 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:25:53 user nova-compute[74319]:   </features>
Oct 30 14:25:53 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:25:53 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:25:53 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:25:53 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:25:53 user nova-compute[74319]:   </clock>
Oct 30 14:25:53 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:25:53 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:25:53 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:25:53 user nova-compute[74319]:   </cpu>
Oct 30 14:25:53 user nova-compute[74319]:   <devices>
Oct 30 14:25:53 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:25:53 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:25:53 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue"/>
Oct 30 14:25:53 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:25:53 user nova-compute[74319]:     </disk>
Oct 30 14:25:53 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:25:53 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:25:53 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk"/>
Oct 30 14:25:53 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:25:53 user nova-compute[74319]:     </disk>
Oct 30 14:25:53 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:25:53 user nova-compute[74319]:       <mac address="fa:16:3e:ff:aa:7d"/>
Oct 30 14:25:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:25:53 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:25:53 user nova-compute[74319]:       <target dev="tapf0aa1859-da"/>
Oct 30 14:25:53 user nova-compute[74319]:     </interface>
Oct 30 14:25:53 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:25:53 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/console.log" append="off"/>
Oct 30 14:25:53 user nova-compute[74319]:     </serial>
Oct 30 14:25:53 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:25:53 user nova-compute[74319]:     <video>
Oct 30 14:25:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:25:53 user nova-compute[74319]:     </video>
Oct 30 14:25:53 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:25:53 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:25:53 user nova-compute[74319]:     </rng>
Oct 30 14:25:53 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:25:53 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:25:53 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:25:53 user nova-compute[74319]:     </memballoon>
Oct 30 14:25:53 user nova-compute[74319]:   </devices>
Oct 30 14:25:53 user nova-compute[74319]: </domain>
Oct 30 14:25:53 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:25:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance destroyed successfully.
Oct 30 14:25:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:25:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:25:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:ff:aa:7d, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:55 user nova-compute[74319]: WARNING nova.compute.manager [req-ca9dca6b-fcc1-4b33-9a8e-b6b9429d4717 req-a4def2b5-0a2f-48e8-bf27-1c121e9c7c98 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state active and task_state rescuing.
Oct 30 14:25:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:25:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:57 user nova-compute[74319]: WARNING nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state active and task_state rescuing.
Oct 30 14:25:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:25:57 user nova-compute[74319]: WARNING nova.compute.manager [req-7c78347c-e6ec-4540-aea7-be354d4583dc req-054b2831-24f0-44b3-926f-b8b8a7943cab service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state active and task_state rescuing.
Oct 30 14:25:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-55d11ffd-a708-4d13-890c-81c08ab6cad3 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:25:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:25:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:25:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:25:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:25:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:25:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:00 user nova-compute[74319]: INFO nova.compute.manager [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attaching volume 7ff53dff-6731-4c2a-a0ea-67036af52ffb to /dev/vdb
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.utils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21c1405-d29b-4ca1-b592-1aeeea9962f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[20484ad7-7fe1-422f-b6c4-c25424c4f1fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c62aa-4627-4b71-b39d-a150340a754b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1b2220-cb5b-41c6-bca2-87e3ab27b0ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:26:00 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7078dc-5f8f-44bc-9265-aa461de766a6]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG os_brick.utils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating existing volume attachment record: 9753c989-2078-4e27-b0ad-7c979df7d15b {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:13 user nova-compute[74319]: INFO nova.compute.manager [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Terminating instance
Oct 30 14:26:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-unplugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] No waiting events found dispatching network-vif-unplugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:26:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-a3d7ddf1-76bf-4098-a403-eb9da093b167 req-17bd6a21-95b7-49aa-9dd7-665566cd6563 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-unplugged-aa923db7-42a3-482f-98a5-0367bf215f58 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Instance destroyed successfully.
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lazy-loading 'resources' on Instance uuid baf66f82-c21a-4abb-8b37-765b8a115f9f {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1943968478',display_name='tempest-VolumesActionsTest-instance-1943968478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1943968478',id=40,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:24:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-ggw12y6l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:24:29Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=baf66f82-c21a-4abb-8b37-765b8a115f9f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "aa923db7-42a3-482f-98a5-0367bf215f58", "address": "fa:16:3e:5a:45:9e", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa923db7-42", "ovs_interfaceid": "aa923db7-42a3-482f-98a5-0367bf215f58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG os_vif [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa923db7-42, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73807655-c3d0-42ee-8b52-c4c157e68a0b) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:26:14 user nova-compute[74319]: INFO os_vif [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=aa923db7-42a3-482f-98a5-0367bf215f58,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa923db7-42')
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Deleting instance files /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f_del
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Deletion of /opt/stack/data/nova/instances/baf66f82-c21a-4abb-8b37-765b8a115f9f_del complete
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.compute.manager [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 30 14:26:14 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Took 0.48 seconds to deallocate network for instance.
Oct 30 14:26:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:26:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:14 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Deleted allocations for instance baf66f82-c21a-4abb-8b37-765b8a115f9f
Oct 30 14:26:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-eb068489-a57f-4b5c-ab74-02a91127c8f9 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.650s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] Acquiring lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] Lock "baf66f82-c21a-4abb-8b37-765b8a115f9f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] No waiting events found dispatching network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:26:15 user nova-compute[74319]: WARNING nova.compute.manager [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received unexpected event network-vif-plugged-aa923db7-42a3-482f-98a5-0367bf215f58 for instance with vm_state deleted and task_state None.
Oct 30 14:26:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c222ab3-f8cc-4401-9077-e1b56f2f0f4c req-00b86276-c5fb-4790-8baa-3ad1a1108dc6 service nova] [instance: baf66f82-c21a-4abb-8b37-765b8a115f9f] Received event network-vif-deleted-aa923db7-42a3-482f-98a5-0367bf215f58 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocKHWCZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:26:19 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:26:19 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:26:19 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[221ac138-4e53-428e-985f-ceb28a2f6f45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:26:19 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59e6e53-505e-454b-9287-79ecf90193fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb] added
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ccfa1-cde6-4614-b390-de6b68ac8e2e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d808d7-ed83-4e60-bd77-5cb898ca68b7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocKHWCZX {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocKHWCZX" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[200555d9-7de9-4241-a108-fca0fe09a204]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocKHWCZX'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66bf4a-b705-42aa-a98e-9a1ef93571ed]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7c0003-e96a-41ad-a00b-556c6394bc10]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b801c5f2-76fb-4cdf-a37b-53f7786b2d09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260]
Oct 30 14:26:19 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260] successful.
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0552cfe2-67ab-4cb1-8724-d40255e1d9b8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[522b6358-348f-470d-930c-6047197bac84]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:19 user nova-compute[74319]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:19 user nova-compute[74319]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)
Oct 30 14:26:19 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64f32d9-f5a7-4f41-b7b4-1e27ce3c9456]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:19 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocKHWCZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23965623365386330', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965623365386330', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG nova.objects.instance [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:26:20 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:26:20 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:26:20 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:26:20 user nova-compute[74319]:   <serial>7ff53dff-6731-4c2a-a0ea-67036af52ffb</serial>
Oct 30 14:26:20 user nova-compute[74319]: </disk>
Oct 30 14:26:20 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:26:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:26:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:26:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No VIF found with MAC fa:16:3e:23:06:a5, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:26:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-55961cd1-727d-408a-af25-3a3046b1e4d7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.500s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:24 user nova-compute[74319]: INFO nova.compute.manager [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Detaching volume 7ff53dff-6731-4c2a-a0ea-67036af52ffb
Oct 30 14:26:24 user nova-compute[74319]: INFO nova.virt.block_device [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attempting to driver detach volume 7ff53dff-6731-4c2a-a0ea-67036af52ffb from mountpoint /dev/vdb
Oct 30 14:26:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Attempting to detach device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:26:24 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:26:24 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:26:24 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:26:24 user nova-compute[74319]:   <serial>7ff53dff-6731-4c2a-a0ea-67036af52ffb</serial>
Oct 30 14:26:24 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:26:24 user nova-compute[74319]: </disk>
Oct 30 14:26:24 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:26:24 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config.
Oct 30 14:26:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:26:24 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:26:24 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:26:24 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:26:24 user nova-compute[74319]:   <serial>7ff53dff-6731-4c2a-a0ea-67036af52ffb</serial>
Oct 30 14:26:24 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:26:24 user nova-compute[74319]: </disk>
Oct 30 14:26:24 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:26:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:26:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:43 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 is timed out.
Oct 30 14:26:44 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config.
Oct 30 14:26:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocKHWCZX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:26:44 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac8736c-edb1-48d9-a0fe-687e0e715e2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:26:44 user nova-compute[74319]: No targets found.
Oct 30 14:26:44 user nova-compute[74319]: iSNS:
Oct 30 14:26:44 user nova-compute[74319]: No targets found.
Oct 30 14:26:44 user nova-compute[74319]: STATIC:
Oct 30 14:26:44 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb
Oct 30 14:26:44 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:26:44 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:26:44 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c
Oct 30 14:26:44 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:26:44 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:26:44 user nova-compute[74319]: FIRMWARE:
Oct 30 14:26:44 user nova-compute[74319]: No targets found.
Oct 30 14:26:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:26:44 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:26:44 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5b049-6b4b-40d9-a361-55481a7f3f46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5066e2-2124-40ff-adac-fe79bb941bc7]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:44 user nova-compute[74319]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)
Oct 30 14:26:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:44 user nova-compute[74319]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb (non-flash)
Oct 30 14:26:44 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9986775b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb81a8-404a-4d37-888a-b63ccb838216]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e74d014-5bbe-4a70-b199-d89b99baeb18]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[696c7b09-4d27-4edd-af2a-4f88db1d1af8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f793b-2632-4aa1-b0d1-5c595b9f2cda]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95d594f-1141-4d5c-9b5c-118174813fb3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:44 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4513fcc6-d01c-44ab-b8c2-59dab1c55fc6]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260]
Oct 30 14:26:45 user nova-compute[74319]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb, portal: 172.16.0.220,3260] successful.
Oct 30 14:26:45 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ff53dff-6731-4c2a-a0ea-67036af52ffb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54fd878-3765-49c5-b7bd-96ea1ab8478f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== disconnect_volume: return (358ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:26:45 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e0d63afc-5d8d-43bd-8b39-d417e9f335b7 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.190s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:26:46 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8493MB free_disk=25.17795181274414GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:46 user nova-compute[74319]: INFO nova.compute.manager [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Terminating instance
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d34934a1-9699-47a4-9ace-6399d8c2bbd1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-unplugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] No waiting events found dispatching network-vif-unplugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-20f3dfe4-9338-4975-a49d-824f83a906bb req-5ab30f03-9816-4e45-967c-48a035386ff2 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-unplugged-0352c6ba-ae56-41d3-87b9-826bf88d220e for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:26:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Instance destroyed successfully.
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid d34934a1-9699-47a4-9ace-6399d8c2bbd1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1657637450',display_name='tempest-TestVolumeBootPattern-server-1657637450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1657637450',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-d00v4rv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:25:26Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=d34934a1-9699-47a4-9ace-6399d8c2bbd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "address": "fa:16:3e:14:08:e7", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0352c6ba-ae", "ovs_interfaceid": "0352c6ba-ae56-41d3-87b9-826bf88d220e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_vif [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0352c6ba-ae, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12e4b166-54e3-419a-b2a0-927dc3bcfcd0) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:47 user nova-compute[74319]: INFO os_vif [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:08:e7,bridge_name='br-int',has_traffic_filtering=True,id=0352c6ba-ae56-41d3-87b9-826bf88d220e,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0352c6ba-ae')
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRjUimbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:26:47 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae377300-6da6-4708-9c22-ad7aec0ad5c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:26:47 user nova-compute[74319]: No targets found.
Oct 30 14:26:47 user nova-compute[74319]: iSNS:
Oct 30 14:26:47 user nova-compute[74319]: No targets found.
Oct 30 14:26:47 user nova-compute[74319]: STATIC:
Oct 30 14:26:47 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c
Oct 30 14:26:47 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:26:47 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:26:47 user nova-compute[74319]: FIRMWARE:
Oct 30 14:26:47 user nova-compute[74319]: No targets found.
Oct 30 14:26:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:26:47 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:26:47 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e31ae79-317f-4c44-89bc-158e062f8afb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[180f9720-9e94-4285-a03f-dbde3b0f3e05]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c (non-flash)
Oct 30 14:26:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a1515990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d78a0-553d-4c53-a5f5-b89858562baf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[531a6a45-884c-4f5d-b08b-f04a7d1aa45f]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8915d11e-8340-4795-8c19-239ccbf04883]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1dbf8-1e15-4585-aec8-13511566ebbb]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_20776504', '/dev/disk/by-id/scsi-23863636137316133', '/dev/disk/by-id/scsi-1SCST_BIO20776504-8cca71a3319b8273') {{(pid=85349) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0024017e-4195-4308-b864-8931d7d49403]: (4, None) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[56487b37-da81-4678-975c-2f6380190477]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f135f420-dd77-4294-939c-61c7e4346042]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260]
Oct 30 14:26:47 user nova-compute[74319]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c, portal: 172.16.0.220,3260] successful.
Oct 30 14:26:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0dfdfbec-1230-48ed-90c4-049effde497c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a182be-c7fd-46da-a7d5-c7a6baf9ab3e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (277ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:26:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Deleting instance files /opt/stack/data/nova/instances/d34934a1-9699-47a4-9ace-6399d8c2bbd1_del
Oct 30 14:26:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Deletion of /opt/stack/data/nova/instances/d34934a1-9699-47a4-9ace-6399d8c2bbd1_del complete
Oct 30 14:26:47 user nova-compute[74319]: INFO nova.compute.manager [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 30 14:26:47 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:26:47 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Took 0.49 seconds to deallocate network for instance.
Oct 30 14:26:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-bde0d83c-8352-4629-a876-3580e011f94d req-c1c58010-64b0-4b63-9534-dbaf33692e89 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-deleted-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] Acquiring lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] No waiting events found dispatching network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:26:48 user nova-compute[74319]: WARNING nova.compute.manager [req-1b301820-557a-406b-af59-8ab9fb42282f req-9c5ca9eb-d16d-43a3-a710-8fee33c09bf8 service nova] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Received unexpected event network-vif-plugged-0352c6ba-ae56-41d3-87b9-826bf88d220e for instance with vm_state active and task_state deleting.
Oct 30 14:26:48 user nova-compute[74319]: INFO nova.compute.manager [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Took 0.81 seconds to detach 1 volumes for instance.
Oct 30 14:26:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: d34934a1-9699-47a4-9ace-6399d8c2bbd1] Deleting volume: 0dfdfbec-1230-48ed-90c4-049effde497c {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:49 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:26:49 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:26:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:49 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance d34934a1-9699-47a4-9ace-6399d8c2bbd1
Oct 30 14:26:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-517ed8a1-0f89-476d-961a-61260f3721ec tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "d34934a1-9699-47a4-9ace-6399d8c2bbd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.843s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:26:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:26:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:26:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:26:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:26:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:27:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:27:05 user nova-compute[74319]: INFO nova.compute.claims [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Claim successful on node user
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:27:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.policy [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dd3b003ba8714cdb92097d33bfa3adee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188dfdda98fd44e4aefdba73b0de9615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:27:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Creating image(s)
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "/opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "/opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "/opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk 1073741824" returned: 0 in 0.051s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Successfully created port: 8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Checking if we can resize image /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Cannot resize image /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Ensure instance console log exists: /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Successfully updated port: 8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquired lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-changed-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.compute.manager [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Refreshing instance network info cache due to event network-changed-8f0530fa-45d8-4031-800e-2645c00b54a3. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] Acquiring lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:27:06 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Updating instance_info_cache with network_info: [{"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Releasing lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Instance network_info: |[{"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] Acquired lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Refreshing network info cache for port 8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Start _get_guest_xml network_info=[{"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:27:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897051876',display_name='tempest-VolumesActionsTest-instance-897051876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897051876',id=42,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-0t06o7c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:27:06Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.objects.instance [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lazy-loading 'pci_devices' on Instance uuid 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:27:07 user nova-compute[74319]:   <uuid>24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b</uuid>
Oct 30 14:27:07 user nova-compute[74319]:   <name>instance-0000002a</name>
Oct 30 14:27:07 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:27:07 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:27:07 user nova-compute[74319]:   <metadata>
Oct 30 14:27:07 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:27:07 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:name>tempest-VolumesActionsTest-instance-897051876</nova:name>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:27:07</nova:creationTime>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:27:07 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:27:07 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:owner>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:user uuid="dd3b003ba8714cdb92097d33bfa3adee">tempest-VolumesActionsTest-2066604202-project-member</nova:user>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:project uuid="188dfdda98fd44e4aefdba73b0de9615">tempest-VolumesActionsTest-2066604202</nova:project>
Oct 30 14:27:07 user nova-compute[74319]:       </nova:owner>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:27:07 user nova-compute[74319]:       <nova:ports>
Oct 30 14:27:07 user nova-compute[74319]:         <nova:port uuid="8f0530fa-45d8-4031-800e-2645c00b54a3">
Oct 30 14:27:07 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 30 14:27:07 user nova-compute[74319]:         </nova:port>
Oct 30 14:27:07 user nova-compute[74319]:       </nova:ports>
Oct 30 14:27:07 user nova-compute[74319]:     </nova:instance>
Oct 30 14:27:07 user nova-compute[74319]:   </metadata>
Oct 30 14:27:07 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:27:07 user nova-compute[74319]:     <system>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="serial">24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b</entry>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="uuid">24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b</entry>
Oct 30 14:27:07 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:27:07 user nova-compute[74319]:     </system>
Oct 30 14:27:07 user nova-compute[74319]:   </sysinfo>
Oct 30 14:27:07 user nova-compute[74319]:   <os>
Oct 30 14:27:07 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:27:07 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:27:07 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:27:07 user nova-compute[74319]:   </os>
Oct 30 14:27:07 user nova-compute[74319]:   <features>
Oct 30 14:27:07 user nova-compute[74319]:     <acpi/>
Oct 30 14:27:07 user nova-compute[74319]:     <apic/>
Oct 30 14:27:07 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:27:07 user nova-compute[74319]:   </features>
Oct 30 14:27:07 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:27:07 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:27:07 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:27:07 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:27:07 user nova-compute[74319]:   </clock>
Oct 30 14:27:07 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:27:07 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:27:07 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:27:07 user nova-compute[74319]:   </cpu>
Oct 30 14:27:07 user nova-compute[74319]:   <devices>
Oct 30 14:27:07 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:27:07 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:27:07 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk"/>
Oct 30 14:27:07 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:27:07 user nova-compute[74319]:     </disk>
Oct 30 14:27:07 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:27:07 user nova-compute[74319]:       <mac address="fa:16:3e:52:a0:f0"/>
Oct 30 14:27:07 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:27:07 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:27:07 user nova-compute[74319]:       <target dev="tap8f0530fa-45"/>
Oct 30 14:27:07 user nova-compute[74319]:     </interface>
Oct 30 14:27:07 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:27:07 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/console.log" append="off"/>
Oct 30 14:27:07 user nova-compute[74319]:     </serial>
Oct 30 14:27:07 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:27:07 user nova-compute[74319]:     <video>
Oct 30 14:27:07 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:27:07 user nova-compute[74319]:     </video>
Oct 30 14:27:07 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:27:07 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:27:07 user nova-compute[74319]:     </rng>
Oct 30 14:27:07 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:27:07 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:27:07 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:27:07 user nova-compute[74319]:     </memballoon>
Oct 30 14:27:07 user nova-compute[74319]:   </devices>
Oct 30 14:27:07 user nova-compute[74319]: </domain>
Oct 30 14:27:07 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897051876',display_name='tempest-VolumesActionsTest-instance-897051876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897051876',id=42,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-0t06o7c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:27:06Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG os_vif [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '981e3544-da4c-5a9b-a5a7-ac7e8c18980b', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f0530fa-45, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f0530fa-45, col_values=(('qos', UUID('2764fd52-fdc1-432c-84cf-8118fe71df17')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f0530fa-45, col_values=(('external_ids', {'iface-id': '8f0530fa-45d8-4031-800e-2645c00b54a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:a0:f0', 'vm-uuid': '24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:07 user nova-compute[74319]: INFO os_vif [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45')
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] No VIF found with MAC fa:16:3e:52:a0:f0, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Updated VIF entry in instance network info cache for port 8f0530fa-45d8-4031-800e-2645c00b54a3. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Updating instance_info_cache with network_info: [{"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:27:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-294b855a-c356-4d48-aa49-822280fde7ec req-3234d30a-dd6d-4314-89b5-8618606cb94b service nova] Releasing lock "refresh_cache-24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:08 user nova-compute[74319]: DEBUG nova.compute.manager [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] No waiting events found dispatching network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:08 user nova-compute[74319]: WARNING nova.compute.manager [req-d09442ae-e738-4cce-b829-1a3f1ed6fb43 req-81007f13-2c97-4d19-9882-24da30bb1916 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received unexpected event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 for instance with vm_state building and task_state spawning.
Oct 30 14:27:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:27:10 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Instance spawned successfully.
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:27:10 user nova-compute[74319]: INFO nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:27:10 user nova-compute[74319]: INFO nova.compute.manager [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Took 5.89 seconds to build instance.
Oct 30 14:27:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f358c713-23a2-49b8-938d-de24c67586a8 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.984s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:10 user nova-compute[74319]: DEBUG nova.compute.manager [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] No waiting events found dispatching network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:10 user nova-compute[74319]: WARNING nova.compute.manager [req-4724a940-eea5-4f85-bba0-675ab29942f9 req-8a3bbc76-2beb-4380-8354-20b7106cf086 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received unexpected event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 for instance with vm_state active and task_state None.
Oct 30 14:27:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG nova.objects.instance [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:20 user nova-compute[74319]: INFO nova.compute.manager [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attaching volume 519ef06e-6fcb-4a9b-8f3f-b360b361fd48 to /dev/vdb
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.utils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a39650-432c-4814-9a24-c4a2ee56540d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d484af-3ce9-498b-a9d6-acaa63b6e244]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f432b3-4543-4b0b-879e-4accdd0376dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b566a9-3969-4676-ac4f-963387808cc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:27:20 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:27:20 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e57871-849d-4531-8c00-40086ded795f]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG os_brick.utils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:27:20 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating existing volume attachment record: ad713031-d6f0-4cd7-b6df-c085ca876c72 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:27:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phQWCNHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:27:39 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:27:39 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:27:39 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa796446-32c7-466c-b896-f34f74742b0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:27:39 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd597145-41d7-4f5a-ae83-55344d0ed624]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48] added
Oct 30 14:27:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a952b3da-658e-463b-add7-923cb8f40b32]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88735c-5543-4fde-b4a6-82bca7ad0474]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phQWCNHF {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v phQWCNHF" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3c5a0-dcde-4462-bc82-ea83ac45b93c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'phQWCNHF'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.085s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f8790-0819-4369-87f3-c4ddbff41251]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[15226fa6-8a69-40ed-9ca2-9d52eec43e91]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:27:39 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:27:39 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:27:39 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:27:39 user nova-compute[74319]: 
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e06a91-3dd8-4642-a923-7776e3ae2e10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260]
Oct 30 14:27:39 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260] successful.
Oct 30 14:27:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6d0852-17d6-4dc0-a26f-97d54b5c1434]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[190c9dcf-0f00-432d-8b1c-a6836b34b4d6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)
Oct 30 14:27:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)
Oct 30 14:27:39 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2b7b24-ff50-48bf-82d8-8ea2fc38b986]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:27:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phQWCNHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23738653166633361', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738653166633361', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:27:40 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:27:40 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:27:40 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:27:40 user nova-compute[74319]:   <serial>519ef06e-6fcb-4a9b-8f3f-b360b361fd48</serial>
Oct 30 14:27:40 user nova-compute[74319]: </disk>
Oct 30 14:27:40 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:27:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No VIF found with MAC fa:16:3e:23:06:a5, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:27:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-f8e394fb-d6c4-43fa-89f8-af993a8c69e9 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.475s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:43 user nova-compute[74319]: INFO nova.compute.manager [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Unrescuing
Oct 30 14:27:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:43 user nova-compute[74319]: INFO nova.compute.manager [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Detaching volume 519ef06e-6fcb-4a9b-8f3f-b360b361fd48
Oct 30 14:27:43 user nova-compute[74319]: INFO nova.virt.block_device [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attempting to driver detach volume 519ef06e-6fcb-4a9b-8f3f-b360b361fd48 from mountpoint /dev/vdb
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Attempting to detach device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:27:43 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:27:43 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:27:43 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:27:43 user nova-compute[74319]:   <serial>519ef06e-6fcb-4a9b-8f3f-b360b361fd48</serial>
Oct 30 14:27:43 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:27:43 user nova-compute[74319]: </disk>
Oct 30 14:27:43 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:27:43 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config.
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:27:43 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:27:43 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:27:43 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:27:43 user nova-compute[74319]:   <serial>519ef06e-6fcb-4a9b-8f3f-b360b361fd48</serial>
Oct 30 14:27:43 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:27:43 user nova-compute[74319]: </disk>
Oct 30 14:27:43 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'flavor' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:44 user nova-compute[74319]: WARNING nova.compute.manager [req-919612a2-a823-43f7-a11d-46e2c3e30b11 req-7087877b-04dc-4f39-86fe-b672720c1bcb service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:27:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:44 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance destroyed successfully.
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:46 user nova-compute[74319]: WARNING nova.compute.manager [req-a38ff778-0e7c-4cf5-9dfb-0f742fb85944 req-d390f97c-19c9-422a-b785-9c0b8c361b40 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68017069-3975-46c8-955a-33c60170d0f1 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:48 user nova-compute[74319]: WARNING nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:27:48 user nova-compute[74319]: WARNING nova.compute.manager [req-08abd1e3-caf9-4b1f-8b53-ef291d489128 req-f46903e7-ef30-421f-8bb6-050186bc0b9e service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:27:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:27:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.13973617553711GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:27:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:27:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [{"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-ce424e4a-8971-4b85-be63-3a74a34916b1" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:27:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:27:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 is timed out.
Oct 30 14:28:04 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config.
Oct 30 14:28:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'phQWCNHF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:28:04 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2b46cf-e2bb-457d-9abb-f6ae112e3cf0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:28:04 user nova-compute[74319]: No targets found.
Oct 30 14:28:04 user nova-compute[74319]: iSNS:
Oct 30 14:28:04 user nova-compute[74319]: No targets found.
Oct 30 14:28:04 user nova-compute[74319]: STATIC:
Oct 30 14:28:04 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48
Oct 30 14:28:04 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:28:04 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:28:04 user nova-compute[74319]: FIRMWARE:
Oct 30 14:28:04 user nova-compute[74319]: No targets found.
Oct 30 14:28:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:28:04 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:28:04 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb92b1d-d147-434b-9124-874cd0123fc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5309291-bd67-413a-9961-45f61d060d27]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)
Oct 30 14:28:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 (non-flash)
Oct 30 14:28:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97457c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[87918f3b-a817-45c6-aeaa-1043b26ef6ca]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec1334-4161-48b1-b6ea-2e11986a0fc7]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb841136-694b-4e51-9ac6-a5087a8c1eba]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a879a53e-0bee-4982-a362-793b6ecced97]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcc89d2-04f3-45b0-a15c-2d0d14e5df3c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8545e-68dc-4682-a945-6f5970b399c5]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260]
Oct 30 14:28:04 user nova-compute[74319]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48, portal: 172.16.0.220,3260] successful.
Oct 30 14:28:04 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:519ef06e-6fcb-4a9b-8f3f-b360b361fd48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f932b74-e3e1-428f-a4cd-d3da7ca9ad5e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== disconnect_volume: return (293ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:28:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:28:05 user nova-compute[74319]: DEBUG nova.objects.instance [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:28:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-1ca96b7b-76d2-4aa4-a0a8-baeb32cf51a4 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.755s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:16 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:28:16 user nova-compute[74319]: INFO nova.compute.claims [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Claim successful on node user
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:28:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.policy [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:28:17 user nova-compute[74319]: INFO nova.virt.block_device [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Booting with volume f8f8aa08-32f3-498b-b4eb-fe4e15917f0e at /dev/vda
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.utils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f19fc4-3f68-4ff4-aca7-62d57ead980a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e282144d-c97c-4fd7-9cb6-b3ebe608af4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b854cab1-a5af-43b0-9e6b-a1b85b9259c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad73de5-5b47-4e97-b43a-5cb943221a47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:28:17 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:28:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b380fd-1506-4d22-8da5-e0e2e3edb704]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG os_brick.utils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating existing volume attachment record: 50849244-e2ae-4ad6-bb3d-85b1259bc509 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:28:17 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Successfully created port: f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Successfully updated port: f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-changed-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Refreshing instance network info cache due to event network-changed-f405977e-8e13-4f21-a77f-279dd7a88361. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] Acquiring lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Instance network_info: |[{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] Acquired lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:28:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Refreshing network info cache for port f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:28:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updated VIF entry in instance network info cache for port f405977e-8e13-4f21-a77f-279dd7a88361. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:28:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:28:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-4dbf9e58-0e6c-42ce-a2b0-774d6586c196 req-ef1e0026-335d-46fa-a150-ea2fe660b790 service nova] Releasing lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:28:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:28:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Creating image(s)
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Ensure instance console log exists: /opt/stack/data/nova/instances/50d1686e-07f5-4664-b060-b0fe314777a6/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Start _get_guest_xml network_info=[{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '50849244-e2ae-4ad6-bb3d-85b1259bc509', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpFViyEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50d1686e-07f5-4664-b060-b0fe314777a6', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 'serial': 'f8f8aa08-32f3-498b-b4eb-fe4e15917f0e'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:28:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:28:35 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpFViyEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:28:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:28:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:28:35 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[92938ebe-cca3-45d8-98d6-59f6bd8aa9fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:28:35 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37e9ac1-f98e-4ae7-83fb-ae69c8a2bcbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e] added
Oct 30 14:28:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5743183c-0d5e-4666-b632-c9abefca5670]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f66990-b84f-40c0-b018-eb5d22809e36]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpFViyEo {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpFViyEo" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7e13ca-58b1-432f-ab35-145e972053ab]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fpFViyEo'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c990d1-a71e-44b3-ad65-5c5311f9bb14]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e868d505-df15-4f66-909d-5b6659910126]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:28:35 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:28:35 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:28:35 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:28:35 user nova-compute[74319]: 
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a314387-2ca4-47d6-a89e-70f76675fa9c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260]
Oct 30 14:28:35 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260] successful.
Oct 30 14:28:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a689ffd-a556-4a6d-aa85-9cb07a5dfdd5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b273209-9c9d-4707-b6a8-f5f168b3fb38]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:35 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc197c4-1e34-4eff-8071-49212fee6905]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:28:35 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpFViyEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23837656131336635', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837656131336635', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1790748510',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnh7WaQM8GqsEPrmrHfZY0ltjEw8B3QQvj0YCbbH8pakYwEiGWKSmgBtULJxb/EqtqA46wvErMSude/HZ/9nA0heLw/rY5mkQ/bL7DE4Kz1C7L/4oMto6WT+ThFkrSX4g==',key_name='tempest-keypair-1050978228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-qasjpxks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=50d1686e-07f5-4664-b060-b0fe314777a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid 50d1686e-07f5-4664-b060-b0fe314777a6 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:28:36 user nova-compute[74319]:   <uuid>50d1686e-07f5-4664-b060-b0fe314777a6</uuid>
Oct 30 14:28:36 user nova-compute[74319]:   <name>instance-0000002b</name>
Oct 30 14:28:36 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:28:36 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:28:36 user nova-compute[74319]:   <metadata>
Oct 30 14:28:36 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:28:36 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:28:36 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1790748510</nova:name>
Oct 30 14:28:36 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:28:35</nova:creationTime>
Oct 30 14:28:36 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:28:36 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:28:36 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:28:36 user nova-compute[74319]:       <nova:owner>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:28:36 user nova-compute[74319]:       </nova:owner>
Oct 30 14:28:36 user nova-compute[74319]:       <nova:ports>
Oct 30 14:28:36 user nova-compute[74319]:         <nova:port uuid="f405977e-8e13-4f21-a77f-279dd7a88361">
Oct 30 14:28:36 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 30 14:28:36 user nova-compute[74319]:         </nova:port>
Oct 30 14:28:36 user nova-compute[74319]:       </nova:ports>
Oct 30 14:28:36 user nova-compute[74319]:     </nova:instance>
Oct 30 14:28:36 user nova-compute[74319]:   </metadata>
Oct 30 14:28:36 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:28:36 user nova-compute[74319]:     <system>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="serial">50d1686e-07f5-4664-b060-b0fe314777a6</entry>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="uuid">50d1686e-07f5-4664-b060-b0fe314777a6</entry>
Oct 30 14:28:36 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:28:36 user nova-compute[74319]:     </system>
Oct 30 14:28:36 user nova-compute[74319]:   </sysinfo>
Oct 30 14:28:36 user nova-compute[74319]:   <os>
Oct 30 14:28:36 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:28:36 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:28:36 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:28:36 user nova-compute[74319]:   </os>
Oct 30 14:28:36 user nova-compute[74319]:   <features>
Oct 30 14:28:36 user nova-compute[74319]:     <acpi/>
Oct 30 14:28:36 user nova-compute[74319]:     <apic/>
Oct 30 14:28:36 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:28:36 user nova-compute[74319]:   </features>
Oct 30 14:28:36 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:28:36 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:28:36 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:28:36 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:28:36 user nova-compute[74319]:   </clock>
Oct 30 14:28:36 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:28:36 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:28:36 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:28:36 user nova-compute[74319]:   </cpu>
Oct 30 14:28:36 user nova-compute[74319]:   <devices>
Oct 30 14:28:36 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:28:36 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:28:36 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:28:36 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:28:36 user nova-compute[74319]:       <serial>f8f8aa08-32f3-498b-b4eb-fe4e15917f0e</serial>
Oct 30 14:28:36 user nova-compute[74319]:     </disk>
Oct 30 14:28:36 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:28:36 user nova-compute[74319]:       <mac address="fa:16:3e:ad:7f:71"/>
Oct 30 14:28:36 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:28:36 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:28:36 user nova-compute[74319]:       <target dev="tapf405977e-8e"/>
Oct 30 14:28:36 user nova-compute[74319]:     </interface>
Oct 30 14:28:36 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:28:36 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/50d1686e-07f5-4664-b060-b0fe314777a6/console.log" append="off"/>
Oct 30 14:28:36 user nova-compute[74319]:     </serial>
Oct 30 14:28:36 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:28:36 user nova-compute[74319]:     <video>
Oct 30 14:28:36 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:28:36 user nova-compute[74319]:     </video>
Oct 30 14:28:36 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:28:36 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:28:36 user nova-compute[74319]:     </rng>
Oct 30 14:28:36 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:28:36 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:28:36 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:28:36 user nova-compute[74319]:     </memballoon>
Oct 30 14:28:36 user nova-compute[74319]:   </devices>
Oct 30 14:28:36 user nova-compute[74319]: </domain>
Oct 30 14:28:36 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1790748510',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnh7WaQM8GqsEPrmrHfZY0ltjEw8B3QQvj0YCbbH8pakYwEiGWKSmgBtULJxb/EqtqA46wvErMSude/HZ/9nA0heLw/rY5mkQ/bL7DE4Kz1C7L/4oMto6WT+ThFkrSX4g==',key_name='tempest-keypair-1050978228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-qasjpxks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:28:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=50d1686e-07f5-4664-b060-b0fe314777a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG os_vif [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69b79bf2-ef80-5167-aaf4-a9749b42de7a', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf405977e-8e, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf405977e-8e, col_values=(('qos', UUID('05dc5af7-c870-429c-be71-2cbd76b1c92d')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf405977e-8e, col_values=(('external_ids', {'iface-id': 'f405977e-8e13-4f21-a77f-279dd7a88361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:7f:71', 'vm-uuid': '50d1686e-07f5-4664-b060-b0fe314777a6'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:36 user nova-compute[74319]: INFO os_vif [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e')
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:28:36 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:ad:7f:71, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] No waiting events found dispatching network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:28:38 user nova-compute[74319]: WARNING nova.compute.manager [req-36e160ca-519c-46a0-a49c-7f095beb7946 req-08cf046c-d849-4616-bfc3-355785fc301e service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received unexpected event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 for instance with vm_state building and task_state spawning.
Oct 30 14:28:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:39 user nova-compute[74319]: INFO nova.compute.manager [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attaching volume 67dc22b8-88ab-41e4-b076-2e4c825233e4 to /dev/vdb
Oct 30 14:28:39 user nova-compute[74319]: DEBUG os_brick.utils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca14f4ae-1960-4005-a7d8-68ce09abfced]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9281104b-25d0-4d74-9185-c1c9c4b6402e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:39 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a4f8b5-8803-4193-89bc-6f2ba662411c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9077b45-a988-4574-ad6c-af39c7521b38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:28:40 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195d05b-af60-484c-bd4f-d9aa7b5cd787]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG os_brick.utils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating existing volume attachment record: f299d609-e7e8-42b0-b797-4a814e6b9f67 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:28:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Instance spawned successfully.
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] No waiting events found dispatching network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:28:40 user nova-compute[74319]: WARNING nova.compute.manager [req-ab35fbce-0bf7-416b-8722-7b16b73cf829 req-7b7a3be4-bfd9-45b3-9488-e3e3829cefd1 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received unexpected event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 for instance with vm_state building and task_state spawning.
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:28:40 user nova-compute[74319]: INFO nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Took 5.02 seconds to spawn the instance on the hypervisor.
Oct 30 14:28:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:28:40 user nova-compute[74319]: INFO nova.compute.manager [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Took 23.75 seconds to build instance.
Oct 30 14:28:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ea814acb-a3d3-4a79-9ba6-36cffe339d50 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.854s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:28:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.136688232421875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 50d1686e-07f5-4664-b060-b0fe314777a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:28:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:28:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:55 user nova-compute[74319]: INFO nova.compute.manager [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Terminating instance
Oct 30 14:28:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-unplugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] No waiting events found dispatching network-vif-unplugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:28:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-aee36f27-f8bb-4a21-8ce4-e6eea110bb78 req-07d730f7-59f9-4845-a6f5-09048560026c service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-unplugged-8f0530fa-45d8-4031-800e-2645c00b54a3 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Instance destroyed successfully.
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lazy-loading 'resources' on Instance uuid 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897051876',display_name='tempest-VolumesActionsTest-instance-897051876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897051876',id=42,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:27:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='188dfdda98fd44e4aefdba73b0de9615',ramdisk_id='',reservation_id='r-0t06o7c0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2066604202',owner_user_name='tempest-VolumesActionsTest-2066604202-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:27:11Z,user_data=None,user_id='dd3b003ba8714cdb92097d33bfa3adee',uuid=24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converting VIF {"id": "8f0530fa-45d8-4031-800e-2645c00b54a3", "address": "fa:16:3e:52:a0:f0", "network": {"id": "24af292f-685b-4633-add9-720dc3c06c9e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1436533178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "188dfdda98fd44e4aefdba73b0de9615", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f0530fa-45", "ovs_interfaceid": "8f0530fa-45d8-4031-800e-2645c00b54a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG os_vif [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f0530fa-45, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2764fd52-fdc1-432c-84cf-8118fe71df17) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:28:56 user nova-compute[74319]: INFO os_vif [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:a0:f0,bridge_name='br-int',has_traffic_filtering=True,id=8f0530fa-45d8-4031-800e-2645c00b54a3,network=Network(24af292f-685b-4633-add9-720dc3c06c9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f0530fa-45')
Oct 30 14:28:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Deleting instance files /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b_del
Oct 30 14:28:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Deletion of /opt/stack/data/nova/instances/24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b_del complete
Oct 30 14:28:56 user nova-compute[74319]: INFO nova.compute.manager [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 30 14:28:56 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:28:56 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Took 0.39 seconds to deallocate network for instance.
Oct 30 14:28:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:57 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Deleted allocations for instance 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a3928127-3283-465b-9398-0a1f7d776970 tempest-VolumesActionsTest-2066604202 tempest-VolumesActionsTest-2066604202-project-member] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.658s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] Acquiring lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] Lock "24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:28:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] No waiting events found dispatching network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:28:57 user nova-compute[74319]: WARNING nova.compute.manager [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received unexpected event network-vif-plugged-8f0530fa-45d8-4031-800e-2645c00b54a3 for instance with vm_state deleted and task_state None.
Oct 30 14:28:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-d3abb7f0-a7ef-437a-8010-bb139a7a160a req-0c3c5c4a-892b-4fd3-8955-f6156cdc5d36 service nova] [instance: 24bfc632-2506-44b2-a0b6-fd0eb0fd6e1b] Received event network-vif-deleted-8f0530fa-45d8-4031-800e-2645c00b54a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMtTGNEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:28:59 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:28:59 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:28:59 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[85be414a-b916-49bd-a2e8-9b68f73f5060]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:28:59 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ff4030-8ac0-403d-b332-7a340cca6115]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4] added
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[898677e0-0418-4e85-b348-781079287988]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[25057847-ce5c-4ed5-9cd7-5e77fef6655f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMtTGNEx {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sMtTGNEx" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb9af51-686e-4d92-bb07-06233111ef21]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sMtTGNEx'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c083b4-5726-479b-b97f-9fdf9cf8bdb9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[331cab81-9a29-4fb7-87f4-358f6e5aecee]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[143585ae-de79-423b-a251-a4cfe9446274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260]
Oct 30 14:28:59 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260] successful.
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f11ce-4668-411d-976c-ae2983d50fde]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aba1a01-8987-46ee-b6c4-a9ca70e52cb2]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:59 user nova-compute[74319]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:28:59 user nova-compute[74319]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)
Oct 30 14:28:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85db88e-59a8-4072-8e67-160414557b4b]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:28:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMtTGNEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26133363839393563', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133363839393563', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:29:00 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:29:00 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:29:00 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:29:00 user nova-compute[74319]:   <serial>67dc22b8-88ab-41e4-b076-2e4c825233e4</serial>
Oct 30 14:29:00 user nova-compute[74319]: </disk>
Oct 30 14:29:00 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:29:00 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] No VIF found with MAC fa:16:3e:23:06:a5, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:29:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-60002374-cbd9-4c58-b14a-6870f78c9807 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.176s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:03 user nova-compute[74319]: INFO nova.compute.manager [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Detaching volume 67dc22b8-88ab-41e4-b076-2e4c825233e4
Oct 30 14:29:03 user nova-compute[74319]: INFO nova.virt.block_device [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Attempting to driver detach volume 67dc22b8-88ab-41e4-b076-2e4c825233e4 from mountpoint /dev/vdb
Oct 30 14:29:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Attempting to detach device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:29:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:29:03 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:29:03 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:29:03 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:29:03 user nova-compute[74319]:   <serial>67dc22b8-88ab-41e4-b076-2e4c825233e4</serial>
Oct 30 14:29:03 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:29:03 user nova-compute[74319]: </disk>
Oct 30 14:29:03 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:29:03 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the persistent domain config.
Oct 30 14:29:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:29:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:29:03 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:29:03 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:29:03 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:29:03 user nova-compute[74319]:   <serial>67dc22b8-88ab-41e4-b076-2e4c825233e4</serial>
Oct 30 14:29:03 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:29:03 user nova-compute[74319]: </disk>
Oct 30 14:29:03 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:29:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:29:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:23 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce424e4a-8971-4b85-be63-3a74a34916b1 is timed out.
Oct 30 14:29:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully detached device vdb from instance ce424e4a-8971-4b85-be63-3a74a34916b1 from the live domain config.
Oct 30 14:29:23 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sMtTGNEx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:29:23 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e344aef-ba29-45f9-aa64-6766ac38fbcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:29:23 user nova-compute[74319]: No targets found.
Oct 30 14:29:23 user nova-compute[74319]: iSNS:
Oct 30 14:29:23 user nova-compute[74319]: No targets found.
Oct 30 14:29:23 user nova-compute[74319]: STATIC:
Oct 30 14:29:23 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e
Oct 30 14:29:23 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:29:23 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:29:23 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4
Oct 30 14:29:23 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:29:23 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:29:23 user nova-compute[74319]: FIRMWARE:
Oct 30 14:29:23 user nova-compute[74319]: No targets found.
Oct 30 14:29:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:29:23 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:29:23 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1804c-774e-4d5c-8616-8380216ff808]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf912f98-3071-4903-ae5f-ac836db14cc9]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:29:23 user nova-compute[74319]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)
Oct 30 14:29:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:29:23 user nova-compute[74319]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 (non-flash)
Oct 30 14:29:23 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974516950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0fe5e5-1a61-41d0-ad37-211c5f2658ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0fbade-1c65-4b04-ad4a-2968e76db4a4]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2effcbc-95a2-4858-8bd1-a15bbc7bbba9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce73e420-9151-44f9-b783-eff1b5089e5c]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45d4c44-695a-4d82-8c3e-d1baaaf42d6d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:29:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca0b709-8bf0-41b8-949b-29a543da1709]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260]
Oct 30 14:29:24 user nova-compute[74319]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4, portal: 172.16.0.220,3260] successful.
Oct 30 14:29:24 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67dc22b8-88ab-41e4-b076-2e4c825233e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e1d6cb-6932-45eb-bbb7-af2969227f42]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.273s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] <== disconnect_volume: return (275ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG nova.objects.instance [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'flavor' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:29:24 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-263b2b3e-c8b1-469d-89d7-2199607cb699 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.689s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:41 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:29:41 user nova-compute[74319]: INFO nova.compute.claims [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Claim successful on node user
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:29:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.policy [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cb6730193bd453fbefe85bfd5e26de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e35c5eed5f4e1ab46fbf58a8f7534c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:29:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Creating image(s)
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk 1073741824" returned: 0 in 0.059s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Successfully created port: 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:29:42 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Cannot resize image /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Ensure instance console log exists: /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Successfully updated port: 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing instance network info cache due to event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance network_info: |[{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start _get_guest_xml network_info=[{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:29:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:29:43 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-873046480',display_name='tempest-ServerRescueNegativeTestJSON-server-873046480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-873046480',id=44,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZMCm1WsxEXIU41FFGs09hEQ7/8R29O0sBJYhNrAcJOVGKf5P4nDxLHDfVHkha+nNk0Vem9eFzkvPlF3dCBjRZmbtQys/34fo2W0M80eZw9kl/Nsm4VgLuZ+caKrNSGsA==',key_name='tempest-keypair-1286195557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-qwtdfj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=ae74b260-4f66-4117-8cfa-9fa9bbcaa381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.objects.instance [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:29:43 user nova-compute[74319]:   <uuid>ae74b260-4f66-4117-8cfa-9fa9bbcaa381</uuid>
Oct 30 14:29:43 user nova-compute[74319]:   <name>instance-0000002c</name>
Oct 30 14:29:43 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:29:43 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:29:43 user nova-compute[74319]:   <metadata>
Oct 30 14:29:43 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:29:43 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-873046480</nova:name>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:29:43</nova:creationTime>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:29:43 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:29:43 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:owner>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:29:43 user nova-compute[74319]:       </nova:owner>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:29:43 user nova-compute[74319]:       <nova:ports>
Oct 30 14:29:43 user nova-compute[74319]:         <nova:port uuid="9581932a-46b2-453b-a25f-9efc0e632d0e">
Oct 30 14:29:43 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:29:43 user nova-compute[74319]:         </nova:port>
Oct 30 14:29:43 user nova-compute[74319]:       </nova:ports>
Oct 30 14:29:43 user nova-compute[74319]:     </nova:instance>
Oct 30 14:29:43 user nova-compute[74319]:   </metadata>
Oct 30 14:29:43 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:29:43 user nova-compute[74319]:     <system>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="serial">ae74b260-4f66-4117-8cfa-9fa9bbcaa381</entry>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="uuid">ae74b260-4f66-4117-8cfa-9fa9bbcaa381</entry>
Oct 30 14:29:43 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:29:43 user nova-compute[74319]:     </system>
Oct 30 14:29:43 user nova-compute[74319]:   </sysinfo>
Oct 30 14:29:43 user nova-compute[74319]:   <os>
Oct 30 14:29:43 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:29:43 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:29:43 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:29:43 user nova-compute[74319]:   </os>
Oct 30 14:29:43 user nova-compute[74319]:   <features>
Oct 30 14:29:43 user nova-compute[74319]:     <acpi/>
Oct 30 14:29:43 user nova-compute[74319]:     <apic/>
Oct 30 14:29:43 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:29:43 user nova-compute[74319]:   </features>
Oct 30 14:29:43 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:29:43 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:29:43 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:29:43 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:29:43 user nova-compute[74319]:   </clock>
Oct 30 14:29:43 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:29:43 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:29:43 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:29:43 user nova-compute[74319]:   </cpu>
Oct 30 14:29:43 user nova-compute[74319]:   <devices>
Oct 30 14:29:43 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:29:43 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:29:43 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk"/>
Oct 30 14:29:43 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:29:43 user nova-compute[74319]:     </disk>
Oct 30 14:29:43 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:29:43 user nova-compute[74319]:       <mac address="fa:16:3e:9f:57:e4"/>
Oct 30 14:29:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:29:43 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:29:43 user nova-compute[74319]:       <target dev="tap9581932a-46"/>
Oct 30 14:29:43 user nova-compute[74319]:     </interface>
Oct 30 14:29:43 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:29:43 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/console.log" append="off"/>
Oct 30 14:29:43 user nova-compute[74319]:     </serial>
Oct 30 14:29:43 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:29:43 user nova-compute[74319]:     <video>
Oct 30 14:29:43 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:29:43 user nova-compute[74319]:     </video>
Oct 30 14:29:43 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:29:43 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:29:43 user nova-compute[74319]:     </rng>
Oct 30 14:29:43 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:29:43 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:29:43 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:29:43 user nova-compute[74319]:     </memballoon>
Oct 30 14:29:43 user nova-compute[74319]:   </devices>
Oct 30 14:29:43 user nova-compute[74319]: </domain>
Oct 30 14:29:43 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-873046480',display_name='tempest-ServerRescueNegativeTestJSON-server-873046480',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-873046480',id=44,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZMCm1WsxEXIU41FFGs09hEQ7/8R29O0sBJYhNrAcJOVGKf5P4nDxLHDfVHkha+nNk0Vem9eFzkvPlF3dCBjRZmbtQys/34fo2W0M80eZw9kl/Nsm4VgLuZ+caKrNSGsA==',key_name='tempest-keypair-1286195557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-qwtdfj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:29:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=ae74b260-4f66-4117-8cfa-9fa9bbcaa381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG os_vif [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d1f654f-d1a7-5cd0-9e77-d437945c57ba', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9581932a-46, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9581932a-46, col_values=(('qos', UUID('1a6ca225-8a7e-4792-a75c-f599e7977913')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9581932a-46, col_values=(('external_ids', {'iface-id': '9581932a-46b2-453b-a25f-9efc0e632d0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:57:e4', 'vm-uuid': 'ae74b260-4f66-4117-8cfa-9fa9bbcaa381'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:43 user nova-compute[74319]: INFO os_vif [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46')
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:9f:57:e4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated VIF entry in instance network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:29:43 user nova-compute[74319]: DEBUG nova.network.neutron [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:29:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-02379d09-6047-4015-a09f-dd3b743145c3 req-11c37fef-c6db-43bc-9aff-c8161c857c0e service nova] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:29:45 user nova-compute[74319]: WARNING nova.compute.manager [req-36930be7-32d2-456f-9c30-06b482f56a3e req-4da242c8-bb15-4d36-93e2-bf601d3d594a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state building and task_state spawning.
Oct 30 14:29:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:45 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:46 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance spawned successfully.
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:29:47 user nova-compute[74319]: WARNING nova.compute.manager [req-16727805-5e8d-406f-abb7-db88b36ffbbe req-d8dab0ce-2d81-4392-86bf-4ca39a6dad7f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state building and task_state spawning.
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:29:47 user nova-compute[74319]: INFO nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 30 14:29:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: INFO nova.compute.manager [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Took 5.73 seconds to build instance.
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-da8a001f-5050-4cf1-a409-d6a0f588faf2 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.913s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:29:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:29:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:29:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8514MB free_disk=25.154640197753906GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 50d1686e-07f5-4664-b060-b0fe314777a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.338s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:29:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:29:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:29:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:29:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:29:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:29:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:29:58 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:29:58 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-changed-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:30:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Refreshing instance network info cache due to event network-changed-f405977e-8e13-4f21-a77f-279dd7a88361. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:30:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] Acquiring lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:30:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] Acquired lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:30:07 user nova-compute[74319]: DEBUG nova.network.neutron [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Refreshing network info cache for port f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:30:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updated VIF entry in instance network info cache for port f405977e-8e13-4f21-a77f-279dd7a88361. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:30:08 user nova-compute[74319]: DEBUG nova.network.neutron [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:30:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-eb8c2c8a-1e85-4615-89b1-30d80e748dee req-7b2e8c38-9f0a-4a5b-a657-ff511957d7a7 service nova] Releasing lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:30:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Verify base images {{(pid=74319) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Image id 6e84464e-b827-48f1-88b9-f2140e869651 yields fingerprint f68f65198c55e40919f7621411c2445def23932d {{(pid=74319) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] image 6e84464e-b827-48f1-88b9-f2140e869651 at (/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d): checking
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] image 6e84464e-b827-48f1-88b9-f2140e869651 at (/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d): image is in use {{(pid=74319) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74319) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] 9785d1bd-6e07-40a5-af8d-41eaf909759e is a valid instance name {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] 9785d1bd-6e07-40a5-af8d-41eaf909759e has a disk file {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e is backed by f68f65198c55e40919f7621411c2445def23932d {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] ce424e4a-8971-4b85-be63-3a74a34916b1 is a valid instance name {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] ce424e4a-8971-4b85-be63-3a74a34916b1 has a disk file {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 is backed by f68f65198c55e40919f7621411c2445def23932d {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] ae74b260-4f66-4117-8cfa-9fa9bbcaa381 is a valid instance name {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] ae74b260-4f66-4117-8cfa-9fa9bbcaa381 has a disk file {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 is backed by f68f65198c55e40919f7621411c2445def23932d {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] 50d1686e-07f5-4664-b060-b0fe314777a6 is a valid instance name {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] 9069a745-a232-47f6-b6a3-cde3ba8c8afb is a valid instance name {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] 9069a745-a232-47f6-b6a3-cde3ba8c8afb has a disk file {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb is backed by f68f65198c55e40919f7621411c2445def23932d {{(pid=74319) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe
Oct 30 14:30:14 user nova-compute[74319]: WARNING nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Active base files: /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Removable base files: /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478 /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2 /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6 /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7 /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9b47bec5963db47a4c6f25ce5e505392fafdd478
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7d9dc99e7cdbbb03bd2f9370e21eae04bb38eb2
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/195f771ef75f645e9abf245eba0ef8fa0d4f0ae6
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1eb6427a3936402162f5a9ab82c5849e261bdbc7
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9a04b0c961807ecbe8d80f99ad420896f7519afe
Oct 30 14:30:14 user nova-compute[74319]: INFO nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d759f4db8f7bee3280c5244b54a12a6a84094fd6
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Verification complete {{(pid=74319) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Verify swap images {{(pid=74319) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 30 14:30:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.imagecache [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Verify ephemeral images {{(pid=74319) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 30 14:30:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:30:25 user nova-compute[74319]: INFO nova.compute.claims [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Claim successful on node user
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:30:25 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:30:25 user nova-compute[74319]: INFO nova.virt.block_device [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Booting with volume snapshot bb2bd5ad-bbd0-4043-a99d-b3f6469c0fa9 at /dev/vda
Oct 30 14:30:25 user nova-compute[74319]: DEBUG nova.policy [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:30:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:26 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Successfully created port: 97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Successfully updated port: 97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-changed-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.compute.manager [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Refreshing instance network info cache due to event network-changed-97ecd3eb-cf86-4469-8994-f690944c96a3. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] Acquiring lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updating instance_info_cache with network_info: [{"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Instance network_info: |[{"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] Acquired lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:30:27 user nova-compute[74319]: DEBUG nova.network.neutron [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Refreshing network info cache for port 97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:30:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updated VIF entry in instance network info cache for port 97ecd3eb-cf86-4469-8994-f690944c96a3. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:30:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updating instance_info_cache with network_info: [{"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:30:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7396265b-1534-4c1c-a832-3b041df4b327 req-f665b128-cd7b-486d-a88c-58393c35b3cf service nova] Releasing lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:30:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.utils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26012243-0ebe-4f87-835b-04a0f69185cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ff14d8-32ab-4073-a0b6-7f1478c24d6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dcd316-38a1-4b6f-8f2b-86846db48fad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40cab82-4708-469e-9978-89708db64c04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:30:31 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:30:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[085956fa-e010-4770-ae9f-b21f19dcd01d]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG os_brick.utils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:30:31 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updating existing volume attachment record: 0d487697-bb9b-4997-ac94-5564e1aa913a {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:30:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:30:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:48 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:30:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8461MB free_disk=25.12356948852539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ce424e4a-8971-4b85-be63-3a74a34916b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 50d1686e-07f5-4664-b060-b0fe314777a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 020abd2e-9e84-4e88-a018-53292b89a1e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:30:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Creating image(s)
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Ensure instance console log exists: /opt/stack/data/nova/instances/020abd2e-9e84-4e88-a018-53292b89a1e8/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Start _get_guest_xml network_info=[{"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T14:30:10Z,direct_url=<?>,disk_format='qcow2',id=32ec3f4e-bb0d-4caa-871f-7ba6c0eab041,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-937493616',owner='090c92eb6b2d4b5987de6989ad9d81f9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T14:30:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '0d487697-bb9b-4997-ac94-5564e1aa913a', 'delete_on_termination': True, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raxVeLCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '020abd2e-9e84-4e88-a018-53292b89a1e8', 'attached_at': '', 'detached_at': '', 'volume_id': '6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 'serial': '6f8c1ffb-6e1b-4992-896b-120d0d174f9d'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:30:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:30:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-30T14:30:10Z,direct_url=<?>,disk_format='qcow2',id=32ec3f4e-bb0d-4caa-871f-7ba6c0eab041,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-937493616',owner='090c92eb6b2d4b5987de6989ad9d81f9',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-30T14:30:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raxVeLCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:30:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:30:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:30:51 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a3c358-b802-408c-b58d-f308877b05bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:30:51 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[736dcf78-a592-4692-88cd-d29405e61de7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d] added
Oct 30 14:30:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1beee8ed-d35a-474f-8c8d-ae816a488b79]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9284a6d0-73d0-4069-8fd1-2d58f0ef54ba]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raxVeLCK {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v raxVeLCK" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[387143b0-f054-4c21-98bc-d9040f75bd7b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'raxVeLCK'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e373ab-aa7f-4f54-a774-a231594087ca]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.386s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[43373b96-9f02-45d3-9ce3-49bb563953b1]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:30:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:30:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba96766-de63-475c-b081-597b3d3ae76c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260]
Oct 30 14:30:52 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260] successful.
Oct 30 14:30:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd18725-0c0c-42ab-8057-bb9329ac9ef7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25ef7cd-e428-43f5-9afa-fb23a8bd63aa]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:30:52 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:30:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:30:52 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:30:52 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7f3f96-385e-4104-be89-e1ed20ae0e0a]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:30:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raxVeLCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23236313263323462', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236313263323462', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1787863276',id=45,image_ref='32ec3f4e-bb0d-4caa-871f-7ba6c0eab041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT5ZAuJRCsIsbF27OaRkFtjwcwqTd54ORSho0xtI6F0gjOwBP5dUx3jlIQmnaQa+JIX4+0rp9TWyjpBKlfr0WpJdwqARhqb/zyUWtPUMmodjpdOpuRlxQY6PcNitKGoAw==',key_name='tempest-keypair-906638215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-2h2rj0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283971583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=020abd2e-9e84-4e88-a018-53292b89a1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.objects.instance [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid 020abd2e-9e84-4e88-a018-53292b89a1e8 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:30:53 user nova-compute[74319]:   <uuid>020abd2e-9e84-4e88-a018-53292b89a1e8</uuid>
Oct 30 14:30:53 user nova-compute[74319]:   <name>instance-0000002d</name>
Oct 30 14:30:53 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:30:53 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:30:53 user nova-compute[74319]:   <metadata>
Oct 30 14:30:53 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:30:53 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1787863276</nova:name>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:30:51</nova:creationTime>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:30:53 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:30:53 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:owner>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:30:53 user nova-compute[74319]:       </nova:owner>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:root type="image" uuid="32ec3f4e-bb0d-4caa-871f-7ba6c0eab041"/>
Oct 30 14:30:53 user nova-compute[74319]:       <nova:ports>
Oct 30 14:30:53 user nova-compute[74319]:         <nova:port uuid="97ecd3eb-cf86-4469-8994-f690944c96a3">
Oct 30 14:30:53 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:30:53 user nova-compute[74319]:         </nova:port>
Oct 30 14:30:53 user nova-compute[74319]:       </nova:ports>
Oct 30 14:30:53 user nova-compute[74319]:     </nova:instance>
Oct 30 14:30:53 user nova-compute[74319]:   </metadata>
Oct 30 14:30:53 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:30:53 user nova-compute[74319]:     <system>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="serial">020abd2e-9e84-4e88-a018-53292b89a1e8</entry>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="uuid">020abd2e-9e84-4e88-a018-53292b89a1e8</entry>
Oct 30 14:30:53 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:30:53 user nova-compute[74319]:     </system>
Oct 30 14:30:53 user nova-compute[74319]:   </sysinfo>
Oct 30 14:30:53 user nova-compute[74319]:   <os>
Oct 30 14:30:53 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:30:53 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:30:53 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:30:53 user nova-compute[74319]:   </os>
Oct 30 14:30:53 user nova-compute[74319]:   <features>
Oct 30 14:30:53 user nova-compute[74319]:     <acpi/>
Oct 30 14:30:53 user nova-compute[74319]:     <apic/>
Oct 30 14:30:53 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:30:53 user nova-compute[74319]:   </features>
Oct 30 14:30:53 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:30:53 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:30:53 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:30:53 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:30:53 user nova-compute[74319]:   </clock>
Oct 30 14:30:53 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:30:53 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:30:53 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:30:53 user nova-compute[74319]:   </cpu>
Oct 30 14:30:53 user nova-compute[74319]:   <devices>
Oct 30 14:30:53 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:30:53 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:30:53 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:30:53 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:30:53 user nova-compute[74319]:       <serial>6f8c1ffb-6e1b-4992-896b-120d0d174f9d</serial>
Oct 30 14:30:53 user nova-compute[74319]:     </disk>
Oct 30 14:30:53 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:30:53 user nova-compute[74319]:       <mac address="fa:16:3e:b4:5c:09"/>
Oct 30 14:30:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:30:53 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:30:53 user nova-compute[74319]:       <target dev="tap97ecd3eb-cf"/>
Oct 30 14:30:53 user nova-compute[74319]:     </interface>
Oct 30 14:30:53 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:30:53 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/020abd2e-9e84-4e88-a018-53292b89a1e8/console.log" append="off"/>
Oct 30 14:30:53 user nova-compute[74319]:     </serial>
Oct 30 14:30:53 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:30:53 user nova-compute[74319]:     <video>
Oct 30 14:30:53 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:30:53 user nova-compute[74319]:     </video>
Oct 30 14:30:53 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:30:53 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:30:53 user nova-compute[74319]:     </rng>
Oct 30 14:30:53 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:30:53 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:30:53 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:30:53 user nova-compute[74319]:     </memballoon>
Oct 30 14:30:53 user nova-compute[74319]:   </devices>
Oct 30 14:30:53 user nova-compute[74319]: </domain>
Oct 30 14:30:53 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1787863276',id=45,image_ref='32ec3f4e-bb0d-4caa-871f-7ba6c0eab041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT5ZAuJRCsIsbF27OaRkFtjwcwqTd54ORSho0xtI6F0gjOwBP5dUx3jlIQmnaQa+JIX4+0rp9TWyjpBKlfr0WpJdwqARhqb/zyUWtPUMmodjpdOpuRlxQY6PcNitKGoAw==',key_name='tempest-keypair-906638215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-2h2rj0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283971583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=020abd2e-9e84-4e88-a018-53292b89a1e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG os_vif [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'caff1408-3bde-5e40-87fa-33c2bafc96b0', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap97ecd3eb-cf, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap97ecd3eb-cf, col_values=(('qos', UUID('3fac371a-d15a-4936-a225-26c4cfe56b7d')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap97ecd3eb-cf, col_values=(('external_ids', {'iface-id': '97ecd3eb-cf86-4469-8994-f690944c96a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:5c:09', 'vm-uuid': '020abd2e-9e84-4e88-a018-53292b89a1e8'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:53 user nova-compute[74319]: INFO os_vif [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf')
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:b4:5c:09, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:30:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] No waiting events found dispatching network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:30:54 user nova-compute[74319]: WARNING nova.compute.manager [req-3511ddd8-f7dc-4dd3-a2ae-fd1c2ba78661 req-a3ed7e3f-2455-4c1b-b7c7-c1a0c6220709 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received unexpected event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 for instance with vm_state building and task_state spawning.
Oct 30 14:30:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:30:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 50d1686e-07f5-4664-b060-b0fe314777a6 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 020abd2e-9e84-4e88-a018-53292b89a1e8 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:56 user nova-compute[74319]: DEBUG nova.compute.manager [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] No waiting events found dispatching network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:30:56 user nova-compute[74319]: WARNING nova.compute.manager [req-136414c3-69c2-44e6-a3db-ceaf6c8c5a88 req-88e389ef-e31e-45af-a22e-057147348e06 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received unexpected event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 for instance with vm_state building and task_state spawning.
Oct 30 14:30:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:30:57 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Instance spawned successfully.
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:30:57 user nova-compute[74319]: INFO nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 30 14:30:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:30:57 user nova-compute[74319]: INFO nova.compute.manager [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Took 31.97 seconds to build instance.
Oct 30 14:30:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-504a4fe7-12f4-49c0-8568-3efe5ac2f185 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.073s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.526s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:30:57 user nova-compute[74319]: INFO nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 30 14:30:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:30:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:30:58 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:58 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:30:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:30:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:31:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:31:01 user nova-compute[74319]: INFO nova.compute.claims [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Claim successful on node user
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:31:01 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:31:01 user nova-compute[74319]: DEBUG nova.policy [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fa7c62635fb42cc9044888540c59def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a47d65c914c4872916c84cc42b46768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:31:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Creating image(s)
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.100s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Successfully created port: 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG nova.virt.images [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.part /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.part /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.converted" returned: 0 in 0.126s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.903s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Successfully updated port: 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing instance network info cache due to event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4,backing_fmt=raw /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4,backing_fmt=raw /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "721b6c0440e527516e6f38430a5a2f9fb7f87df4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Cannot resize image /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Ensure instance console log exists: /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance network_info: |[{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.neutron [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start _get_guest_xml network_info=[{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T14:30:58Z,direct_url=<?>,disk_format='qcow2',id=a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0,min_disk=0,min_ram=0,name='tempest-scenario-img--1673270207',owner='5a47d65c914c4872916c84cc42b46768',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T14:31:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:31:03 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:03 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T14:30:58Z,direct_url=<?>,disk_format='qcow2',id=a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0,min_disk=0,min_ram=0,name='tempest-scenario-img--1673270207',owner='5a47d65c914c4872916c84cc42b46768',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T14:31:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:31:02Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:31:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:31:04 user nova-compute[74319]:   <uuid>5a99c1a5-f267-4469-8800-a8ff0166645b</uuid>
Oct 30 14:31:04 user nova-compute[74319]:   <name>instance-0000002e</name>
Oct 30 14:31:04 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:31:04 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:31:04 user nova-compute[74319]:   <metadata>
Oct 30 14:31:04 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:31:04 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:name>tempest-TestMinimumBasicScenario-server-1934002999</nova:name>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:31:03</nova:creationTime>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:31:04 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:31:04 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:owner>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:user uuid="9fa7c62635fb42cc9044888540c59def">tempest-TestMinimumBasicScenario-382480661-project-member</nova:user>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:project uuid="5a47d65c914c4872916c84cc42b46768">tempest-TestMinimumBasicScenario-382480661</nova:project>
Oct 30 14:31:04 user nova-compute[74319]:       </nova:owner>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:root type="image" uuid="a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0"/>
Oct 30 14:31:04 user nova-compute[74319]:       <nova:ports>
Oct 30 14:31:04 user nova-compute[74319]:         <nova:port uuid="3de22b55-0afb-4c90-b8bb-528093ae43df">
Oct 30 14:31:04 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:31:04 user nova-compute[74319]:         </nova:port>
Oct 30 14:31:04 user nova-compute[74319]:       </nova:ports>
Oct 30 14:31:04 user nova-compute[74319]:     </nova:instance>
Oct 30 14:31:04 user nova-compute[74319]:   </metadata>
Oct 30 14:31:04 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:31:04 user nova-compute[74319]:     <system>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="serial">5a99c1a5-f267-4469-8800-a8ff0166645b</entry>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="uuid">5a99c1a5-f267-4469-8800-a8ff0166645b</entry>
Oct 30 14:31:04 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:31:04 user nova-compute[74319]:     </system>
Oct 30 14:31:04 user nova-compute[74319]:   </sysinfo>
Oct 30 14:31:04 user nova-compute[74319]:   <os>
Oct 30 14:31:04 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:31:04 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:31:04 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:31:04 user nova-compute[74319]:   </os>
Oct 30 14:31:04 user nova-compute[74319]:   <features>
Oct 30 14:31:04 user nova-compute[74319]:     <acpi/>
Oct 30 14:31:04 user nova-compute[74319]:     <apic/>
Oct 30 14:31:04 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:31:04 user nova-compute[74319]:   </features>
Oct 30 14:31:04 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:31:04 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:31:04 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:31:04 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:31:04 user nova-compute[74319]:   </clock>
Oct 30 14:31:04 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:31:04 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:31:04 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:31:04 user nova-compute[74319]:   </cpu>
Oct 30 14:31:04 user nova-compute[74319]:   <devices>
Oct 30 14:31:04 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:31:04 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:31:04 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk"/>
Oct 30 14:31:04 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:31:04 user nova-compute[74319]:     </disk>
Oct 30 14:31:04 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:31:04 user nova-compute[74319]:       <mac address="fa:16:3e:07:a4:29"/>
Oct 30 14:31:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:31:04 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:31:04 user nova-compute[74319]:       <target dev="tap3de22b55-0a"/>
Oct 30 14:31:04 user nova-compute[74319]:     </interface>
Oct 30 14:31:04 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:31:04 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/console.log" append="off"/>
Oct 30 14:31:04 user nova-compute[74319]:     </serial>
Oct 30 14:31:04 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:31:04 user nova-compute[74319]:     <video>
Oct 30 14:31:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:31:04 user nova-compute[74319]:     </video>
Oct 30 14:31:04 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:31:04 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:31:04 user nova-compute[74319]:     </rng>
Oct 30 14:31:04 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:31:04 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:31:04 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:31:04 user nova-compute[74319]:     </memballoon>
Oct 30 14:31:04 user nova-compute[74319]:   </devices>
Oct 30 14:31:04 user nova-compute[74319]: </domain>
Oct 30 14:31:04 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:31:02Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG os_vif [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4821bf62-3f94-5991-858d-29b30b7a699b', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de22b55-0a, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de22b55-0a, col_values=(('qos', UUID('f316e7e7-aa5e-4be2-b9af-68a3661eb65a')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de22b55-0a, col_values=(('external_ids', {'iface-id': '3de22b55-0afb-4c90-b8bb-528093ae43df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:a4:29', 'vm-uuid': '5a99c1a5-f267-4469-8800-a8ff0166645b'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:04 user nova-compute[74319]: INFO os_vif [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a')
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No VIF found with MAC fa:16:3e:07:a4:29, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updated VIF entry in instance network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6032ee31-06c8-4aa3-8596-b722716584dd req-da00ebaf-e883-4c12-9e7f-336f31fd871c service nova] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:05 user nova-compute[74319]: WARNING nova.compute.manager [req-86e6fedd-1889-423f-a0ff-da0bf257d8e3 req-7d490a68-1a15-480c-af3a-c03f9152b403 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state building and task_state spawning.
Oct 30 14:31:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:31:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:31:07 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance spawned successfully.
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:31:07 user nova-compute[74319]: INFO nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:07 user nova-compute[74319]: WARNING nova.compute.manager [req-388a95f3-369f-4198-9034-2860657f327a req-1648df24-fe86-44ad-8d84-84e989ecd70d service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state building and task_state spawning.
Oct 30 14:31:07 user nova-compute[74319]: INFO nova.compute.manager [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Took 6.59 seconds to build instance.
Oct 30 14:31:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-ece77e94-3bb5-4351-832f-499f9dd4ec7c tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.702s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:11 user nova-compute[74319]: INFO nova.compute.manager [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Terminating instance
Oct 30 14:31:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:11 user nova-compute[74319]: DEBUG nova.compute.manager [req-a2f9e792-5c32-46a8-b1ef-83da595e56ab req-91f0d2cd-5c5c-4af3-915a-63a80676812b service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Instance destroyed successfully.
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.objects.instance [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lazy-loading 'resources' on Instance uuid ce424e4a-8971-4b85-be63-3a74a34916b1 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:22:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-465075480',display_name='tempest-SnapshotDataIntegrityTests-server-465075480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-465075480',id=39,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQ2IrHagMeW1hLB/a3XxRMh+05fwroH4D8bnyDrqbm1EPjJAqyPLTMcKB501XQjuWbH9MEZeBnqz9/UScTR+6cePe9YEX2tQ24D/PquLfU/dqWwjvbRkUJd2TAWDQnlkQ==',key_name='tempest-keypair-176585519',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:22:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c203715ae9984113b55404207018baaf',ramdisk_id='',reservation_id='r-yo4155ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1972941964',owner_user_name='tempest-SnapshotDataIntegrityTests-1972941964-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:22:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='63b5a0856f194976b1920f181cd9b3e4',uuid=ce424e4a-8971-4b85-be63-3a74a34916b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converting VIF {"id": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "address": "fa:16:3e:23:06:a5", "network": {"id": "c389840b-eaa9-4bfa-a973-fbf91667b51d", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1323719846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c203715ae9984113b55404207018baaf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4afe8ef-b0", "ovs_interfaceid": "f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG os_vif [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4afe8ef-b0, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ebee6c45-03f5-4fee-96e1-347d903155e8) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: INFO os_vif [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:06:a5,bridge_name='br-int',has_traffic_filtering=True,id=f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d,network=Network(c389840b-eaa9-4bfa-a973-fbf91667b51d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4afe8ef-b0')
Oct 30 14:31:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Deleting instance files /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1_del
Oct 30 14:31:12 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Deletion of /opt/stack/data/nova/instances/ce424e4a-8971-4b85-be63-3a74a34916b1_del complete
Oct 30 14:31:12 user nova-compute[74319]: INFO nova.compute.manager [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 30 14:31:12 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:13 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Took 0.86 seconds to deallocate network for instance.
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-ce0c42b6-085e-4b9e-8395-6c130bb01069 req-27503e62-0fe3-41e6-b515-40c50c4e89b4 service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-deleted-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Deleted allocations for instance ce424e4a-8971-4b85-be63-3a74a34916b1
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-937f8501-6a2e-4f2a-9344-c9cd651234d0 tempest-SnapshotDataIntegrityTests-1972941964 tempest-SnapshotDataIntegrityTests-1972941964-project-member] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.361s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:13 user nova-compute[74319]: WARNING nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state deleted and task_state None.
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:13 user nova-compute[74319]: WARNING nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state deleted and task_state None.
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:13 user nova-compute[74319]: WARNING nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state deleted and task_state None.
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:13 user nova-compute[74319]: WARNING nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-unplugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state deleted and task_state None.
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Acquiring lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] Lock "ce424e4a-8971-4b85-be63-3a74a34916b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:13 user nova-compute[74319]: DEBUG nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] No waiting events found dispatching network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:13 user nova-compute[74319]: WARNING nova.compute.manager [req-bb575edf-cc64-4215-bb0a-abc0a3d5b614 req-88425fb7-194b-483a-90b7-96c48b941b7f service nova] [instance: ce424e4a-8971-4b85-be63-3a74a34916b1] Received unexpected event network-vif-plugged-f4afe8ef-b09a-4ddb-96a7-8604ace7bb5d for instance with vm_state deleted and task_state None.
Oct 30 14:31:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing instance network info cache due to event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG nova.network.neutron [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'flavor' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:32 user nova-compute[74319]: INFO nova.compute.manager [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Attaching volume edd9f80c-8bc6-477b-8201-ecc4526d6eb6 to /dev/vdb
Oct 30 14:31:32 user nova-compute[74319]: DEBUG os_brick.utils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:31:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4958d6d-3401-45e4-a354-cdcf7db90036]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[678198e6-09e6-4d78-9211-5aad390e4414]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cee82b-bbc7-41f9-a1f8-a4520270d5ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de373d-e195-4d6f-9729-bc4fda84ad43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated VIF entry in instance network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12c51ea6-6f8c-4fb0-b17e-80995cff157c req-8153959a-b83f-455a-a346-cb70c386644b service nova] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:31:33 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:31:33 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ddb6a49-8981-433c-8423-f5778ed82329]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG os_brick.utils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:31:33 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating existing volume attachment record: b54ae5d3-f297-4fca-9645-879ccba41d36 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:31:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:31:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdCVOLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:31:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:31:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:31:51 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:51 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8275MB free_disk=25.051708221435547GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa71464-f2b9-43af-aa7a-9ed6fb3dad70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:31:51 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd033fd-f269-4c2e-8379-0049644d062d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6] added
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd2e896-fcb6-4e6a-82ea-5c95e44bcea6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39d01d5-48fa-4f5c-b077-781936bbfd1f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdCVOLDY {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vdCVOLDY" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd68527-23d8-4ea3-aff2-6595f794ba93]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vdCVOLDY'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5bd14-fa8d-43ce-9534-de2d5849c22b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c120bc4d-12c4-4d78-b43a-3d04320f079c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a0781-0cb9-440e-a0d6-2cdc2932f19c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260]
Oct 30 14:31:51 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260] successful.
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78aad10-be4a-4d8a-8f1d-71bf3bd4b8bf]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 50d1686e-07f5-4664-b060-b0fe314777a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 020abd2e-9e84-4e88-a018-53292b89a1e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a99c1a5-f267-4469-8800-a8ff0166645b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6c9f3a-68f4-4335-973a-4e694f1f720e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:31:51 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:31:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[700600f4-d71d-47e1-b17e-53f1efe9f282]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdCVOLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:31:51 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.660s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23963376262383636', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963376262383636', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'flavor' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:31:52 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:31:52 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:31:52 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:31:52 user nova-compute[74319]:   <serial>edd9f80c-8bc6-477b-8201-ecc4526d6eb6</serial>
Oct 30 14:31:52 user nova-compute[74319]: </disk>
Oct 30 14:31:52 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:31:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:31:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:31:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:9f:57:e4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:31:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b69b6bf3-8b64-4cbf-873e-b715e2a64ca8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.414s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:54 user nova-compute[74319]: INFO nova.compute.manager [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Rescuing
Oct 30 14:31:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:31:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:31:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:31:54 user nova-compute[74319]: DEBUG nova.network.neutron [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:55 user nova-compute[74319]: WARNING nova.compute.manager [req-57e3f32c-5f04-4ff5-a823-e43c80a37349 req-aa9e112e-f94f-4cd7-9a0e-6591f055a21a service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state active and task_state rescuing.
Oct 30 14:31:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance destroyed successfully.
Oct 30 14:31:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Attempting rescue
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance directory exists: not creating {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 30 14:31:55 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Creating image(s)
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'trusted_certs' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue" returned: 0 in 0.048s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'migration_context' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<ae74b260-4f66-4117-8cfa-9fa9bbcaa381> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start _get_guest_xml network_info=[{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:9f:57:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6e84464e-b827-48f1-88b9-f2140e869651', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<ae74b260-4f66-4117-8cfa-9fa9bbcaa381> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'numa_topology' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<ae74b260-4f66-4117-8cfa-9fa9bbcaa381> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:31:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<ae74b260-4f66-4117-8cfa-9fa9bbcaa381> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-873046480',display_name='tempest-ServerRescueNegativeTestJSON-server-873046480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-873046480',id=44,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZMCm1WsxEXIU41FFGs09hEQ7/8R29O0sBJYhNrAcJOVGKf5P4nDxLHDfVHkha+nNk0Vem9eFzkvPlF3dCBjRZmbtQys/34fo2W0M80eZw9kl/Nsm4VgLuZ+caKrNSGsA==',key_name='tempest-keypair-1286195557',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:29:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-qwtdfj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:29:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=ae74b260-4f66-4117-8cfa-9fa9bbcaa381,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:9f:57:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "vif_mac": "fa:16:3e:9f:57:e4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.instance [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'pci_devices' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.objects.base [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Object Instance<ae74b260-4f66-4117-8cfa-9fa9bbcaa381> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:31:56 user nova-compute[74319]:   <uuid>ae74b260-4f66-4117-8cfa-9fa9bbcaa381</uuid>
Oct 30 14:31:56 user nova-compute[74319]:   <name>instance-0000002c</name>
Oct 30 14:31:56 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:31:56 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:31:56 user nova-compute[74319]:   <metadata>
Oct 30 14:31:56 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:31:56 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-873046480</nova:name>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:31:56</nova:creationTime>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:31:56 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:31:56 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:owner>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:user uuid="2cb6730193bd453fbefe85bfd5e26de2">tempest-ServerRescueNegativeTestJSON-1158390003-project-member</nova:user>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:project uuid="76e35c5eed5f4e1ab46fbf58a8f7534c">tempest-ServerRescueNegativeTestJSON-1158390003</nova:project>
Oct 30 14:31:56 user nova-compute[74319]:       </nova:owner>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:31:56 user nova-compute[74319]:       <nova:ports>
Oct 30 14:31:56 user nova-compute[74319]:         <nova:port uuid="9581932a-46b2-453b-a25f-9efc0e632d0e">
Oct 30 14:31:56 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:31:56 user nova-compute[74319]:         </nova:port>
Oct 30 14:31:56 user nova-compute[74319]:       </nova:ports>
Oct 30 14:31:56 user nova-compute[74319]:     </nova:instance>
Oct 30 14:31:56 user nova-compute[74319]:   </metadata>
Oct 30 14:31:56 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:31:56 user nova-compute[74319]:     <system>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="serial">ae74b260-4f66-4117-8cfa-9fa9bbcaa381</entry>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="uuid">ae74b260-4f66-4117-8cfa-9fa9bbcaa381</entry>
Oct 30 14:31:56 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:31:56 user nova-compute[74319]:     </system>
Oct 30 14:31:56 user nova-compute[74319]:   </sysinfo>
Oct 30 14:31:56 user nova-compute[74319]:   <os>
Oct 30 14:31:56 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:31:56 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:31:56 user nova-compute[74319]:   </os>
Oct 30 14:31:56 user nova-compute[74319]:   <features>
Oct 30 14:31:56 user nova-compute[74319]:     <acpi/>
Oct 30 14:31:56 user nova-compute[74319]:     <apic/>
Oct 30 14:31:56 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:31:56 user nova-compute[74319]:   </features>
Oct 30 14:31:56 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:31:56 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:31:56 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:31:56 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:31:56 user nova-compute[74319]:   </clock>
Oct 30 14:31:56 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:31:56 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:31:56 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:31:56 user nova-compute[74319]:   </cpu>
Oct 30 14:31:56 user nova-compute[74319]:   <devices>
Oct 30 14:31:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:31:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:31:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue"/>
Oct 30 14:31:56 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:31:56 user nova-compute[74319]:     </disk>
Oct 30 14:31:56 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:31:56 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:31:56 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk"/>
Oct 30 14:31:56 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:31:56 user nova-compute[74319]:     </disk>
Oct 30 14:31:56 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:31:56 user nova-compute[74319]:       <mac address="fa:16:3e:9f:57:e4"/>
Oct 30 14:31:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:31:56 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:31:56 user nova-compute[74319]:       <target dev="tap9581932a-46"/>
Oct 30 14:31:56 user nova-compute[74319]:     </interface>
Oct 30 14:31:56 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:31:56 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/console.log" append="off"/>
Oct 30 14:31:56 user nova-compute[74319]:     </serial>
Oct 30 14:31:56 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:31:56 user nova-compute[74319]:     <video>
Oct 30 14:31:56 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:31:56 user nova-compute[74319]:     </video>
Oct 30 14:31:56 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:31:56 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:31:56 user nova-compute[74319]:     </rng>
Oct 30 14:31:56 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:31:56 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:31:56 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:31:56 user nova-compute[74319]:     </memballoon>
Oct 30 14:31:56 user nova-compute[74319]:   </devices>
Oct 30 14:31:56 user nova-compute[74319]: </domain>
Oct 30 14:31:56 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:31:56 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance destroyed successfully.
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] No VIF found with MAC fa:16:3e:9f:57:e4, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:31:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:57 user nova-compute[74319]: WARNING nova.compute.manager [req-fb517426-d53a-4c55-b6b9-ea8e8ba4a433 req-f59a0ac0-da67-4ac0-82ef-ffbe6faac166 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state active and task_state rescuing.
Oct 30 14:31:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [{"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-50d1686e-07f5-4664-b060-b0fe314777a6" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:59 user nova-compute[74319]: WARNING nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state active and task_state rescuing.
Oct 30 14:31:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:31:59 user nova-compute[74319]: WARNING nova.compute.manager [req-0c927482-239d-4c08-be59-eb2b1a5956e7 req-8348e5d9-db84-4097-9ad0-4383a37b1822 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state active and task_state rescuing.
Oct 30 14:31:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-50b023ea-a948-4b7d-b704-9efd695ff8d8 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:31:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-changed-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Refreshing instance network info cache due to event network-changed-97ecd3eb-cf86-4469-8994-f690944c96a3. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] Acquiring lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] Acquired lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Refreshing network info cache for port 97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updated VIF entry in instance network info cache for port 97ecd3eb-cf86-4469-8994-f690944c96a3. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.network.neutron [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updating instance_info_cache with network_info: [{"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-96306bea-f05f-4d71-a212-71a8d0b55205 req-6978cac1-b220-48a7-943e-482353745f65 service nova] Releasing lock "refresh_cache-020abd2e-9e84-4e88-a018-53292b89a1e8" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:16 user nova-compute[74319]: INFO nova.compute.manager [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Terminating instance
Oct 30 14:32:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:32:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-unplugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] No waiting events found dispatching network-vif-unplugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-36ebf717-73ca-4ec6-86f9-2183a64e774b req-d035c115-d095-4762-bb03-75877a857330 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-unplugged-97ecd3eb-cf86-4469-8994-f690944c96a3 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Instance destroyed successfully.
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.objects.instance [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid 020abd2e-9e84-4e88-a018-53292b89a1e8 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1787863276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1787863276',id=45,image_ref='32ec3f4e-bb0d-4caa-871f-7ba6c0eab041',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT5ZAuJRCsIsbF27OaRkFtjwcwqTd54ORSho0xtI6F0gjOwBP5dUx3jlIQmnaQa+JIX4+0rp9TWyjpBKlfr0WpJdwqARhqb/zyUWtPUMmodjpdOpuRlxQY6PcNitKGoAw==',key_name='tempest-keypair-906638215',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:30:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-2h2rj0kb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1283971583',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=020abd2e-9e84-4e88-a018-53292b89a1e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "97ecd3eb-cf86-4469-8994-f690944c96a3", "address": "fa:16:3e:b4:5c:09", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap97ecd3eb-cf", "ovs_interfaceid": "97ecd3eb-cf86-4469-8994-f690944c96a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_vif [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap97ecd3eb-cf, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3fac371a-d15a-4936-a225-26c4cfe56b7d) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:17 user nova-compute[74319]: INFO os_vif [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:5c:09,bridge_name='br-int',has_traffic_filtering=True,id=97ecd3eb-cf86-4469-8994-f690944c96a3,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap97ecd3eb-cf')
Oct 30 14:32:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'raxVeLCK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:32:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb00425-0439-416c-814f-e1cd0c493989]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:32:17 user nova-compute[74319]: No targets found.
Oct 30 14:32:17 user nova-compute[74319]: iSNS:
Oct 30 14:32:17 user nova-compute[74319]: No targets found.
Oct 30 14:32:17 user nova-compute[74319]: STATIC:
Oct 30 14:32:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e
Oct 30 14:32:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:32:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:32:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6
Oct 30 14:32:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:32:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:32:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d
Oct 30 14:32:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:32:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:32:17 user nova-compute[74319]: FIRMWARE:
Oct 30 14:32:17 user nova-compute[74319]: No targets found.
Oct 30 14:32:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:32:17 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:32:17 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d95e3d-8e3c-4945-a45d-67c65faba899]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec4474-ffb1-4607-9a8e-c22782917402]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:32:17 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:32:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:32:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:32:17 user nova-compute[74319]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d (non-flash)
Oct 30 14:32:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:32:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe97457c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf232de2-1650-43c8-87d1-453270b2615a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[37390f2e-765a-4f2d-86f0-3ffa2429a805]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94345c-999f-4ae6-9043-7e85d669c175]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdae175-dcbe-4228-9135-4878a16419d5]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c20041-3f0c-4013-8429-ff0069b69414]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cc3a78-03c9-4a13-b4b5-f659b508bc13]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260]
Oct 30 14:32:17 user nova-compute[74319]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d, portal: 172.16.0.220,3260] successful.
Oct 30 14:32:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:32:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f8c1ffb-6e1b-4992-896b-120d0d174f9d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3433eb-0f05-477b-a662-353d970732e0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (290ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:32:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Deleting instance files /opt/stack/data/nova/instances/020abd2e-9e84-4e88-a018-53292b89a1e8_del
Oct 30 14:32:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Deletion of /opt/stack/data/nova/instances/020abd2e-9e84-4e88-a018-53292b89a1e8_del complete
Oct 30 14:32:18 user nova-compute[74319]: INFO nova.compute.manager [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Took 1.15 seconds to destroy the instance on the hypervisor.
Oct 30 14:32:18 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:32:18 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:32:18 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Took 0.78 seconds to deallocate network for instance.
Oct 30 14:32:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] Acquiring lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] No waiting events found dispatching network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:32:19 user nova-compute[74319]: WARNING nova.compute.manager [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received unexpected event network-vif-plugged-97ecd3eb-cf86-4469-8994-f690944c96a3 for instance with vm_state active and task_state deleting.
Oct 30 14:32:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-e4dc7e9b-5269-431b-89dc-6bf1184d0a71 req-78f13295-f3d3-490d-938f-322c245cef90 service nova] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Received event network-vif-deleted-97ecd3eb-cf86-4469-8994-f690944c96a3 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:32:19 user nova-compute[74319]: INFO nova.compute.manager [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Took 0.84 seconds to detach 1 volumes for instance.
Oct 30 14:32:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 020abd2e-9e84-4e88-a018-53292b89a1e8] Deleting volume: 6f8c1ffb-6e1b-4992-896b-120d0d174f9d {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:20 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:32:20 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:32:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:20 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance 020abd2e-9e84-4e88-a018-53292b89a1e8
Oct 30 14:32:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-e5df9d76-75b1-431a-8a9e-d5a7e4e8e5be tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "020abd2e-9e84-4e88-a018-53292b89a1e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.301s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:32:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:50 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:32:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:32:53 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8494MB free_disk=25.048580169677734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 50d1686e-07f5-4664-b060-b0fe314777a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a99c1a5-f267-4469-8800-a8ff0166645b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:32:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.344s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:55 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:32:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:32:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG nova.objects.instance [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:32:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:32:58 user nova-compute[74319]: INFO nova.compute.manager [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Attaching volume 1d6b69cd-301c-442f-bee5-e18e2f4b3b91 to /dev/vdb
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.utils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa18ad3-bc55-41bf-be0c-6f70b2b4deb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23da048-7ac8-4650-9801-df8aa1179890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96218f58-bb97-43ef-acf7-6cc96f69d146]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[659428be-36ac-48ae-8106-8b687f2ec246]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:32:58 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:32:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1b4733-afec-4e06-8788-e6119afc6bb8]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG os_brick.utils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:32:58 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating existing volume attachment record: 61e6cdce-b51b-47d2-a095-3d9f4b0dde1d {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:33:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:33:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:17 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b5c2d-ecf7-4547-9ef4-0d917034d2b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:33:17 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dcf258-e437-4ac3-bb19-656e81b688a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91] added
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fce3b8-8e18-45d6-9c34-1b3e5f49b4a5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4581a0-8a2e-4ad4-99cd-164d8057edb4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVkItCBp {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVkItCBp" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04f9116-2cf8-4e96-a39f-81556eda4f06]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVkItCBp'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac26fe-1808-47dc-b723-0b687e5ebc05]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[481d1a01-47b3-42a6-9f79-06a1e4289952]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cb3d8f-bbac-4ccc-aa19-1ec63e99c0ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]
Oct 30 14:33:17 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f166c035-e7a9-469e-9516-2db952cf38ea]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[11303eed-19cb-47d0-9f3e-09d16c3be75e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2800a661-c6fc-452c-8eb9-cf00a6412764]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: INFO nova.compute.manager [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Terminating instance
Oct 30 14:33:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-unplugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] No waiting events found dispatching network-vif-unplugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-81eaba30-f4f1-479e-8e58-d1215d482697 req-3d1b0279-4786-4421-b346-b18e0f5ed35a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-unplugged-f405977e-8e13-4f21-a77f-279dd7a88361 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Instance destroyed successfully.
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.objects.instance [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid 50d1686e-07f5-4664-b060-b0fe314777a6 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:28:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1790748510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1790748510',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnh7WaQM8GqsEPrmrHfZY0ltjEw8B3QQvj0YCbbH8pakYwEiGWKSmgBtULJxb/EqtqA46wvErMSude/HZ/9nA0heLw/rY5mkQ/bL7DE4Kz1C7L/4oMto6WT+ThFkrSX4g==',key_name='tempest-keypair-1050978228',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-qasjpxks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=50d1686e-07f5-4664-b060-b0fe314777a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "f405977e-8e13-4f21-a77f-279dd7a88361", "address": "fa:16:3e:ad:7f:71", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf405977e-8e", "ovs_interfaceid": "f405977e-8e13-4f21-a77f-279dd7a88361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_vif [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf405977e-8e, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05dc5af7-c870-429c-be71-2cbd76b1c92d) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:18 user nova-compute[74319]: INFO os_vif [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=f405977e-8e13-4f21-a77f-279dd7a88361,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf405977e-8e')
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpFViyEo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:33:18 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '26562386663663035', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562386663663035', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.187s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.objects.instance [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021f907-c621-46e8-bc19-11ce68df67c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:33:18 user nova-compute[74319]: No targets found.
Oct 30 14:33:18 user nova-compute[74319]: iSNS:
Oct 30 14:33:18 user nova-compute[74319]: No targets found.
Oct 30 14:33:18 user nova-compute[74319]: STATIC:
Oct 30 14:33:18 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e
Oct 30 14:33:18 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:33:18 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:33:18 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6
Oct 30 14:33:18 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:33:18 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:33:18 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91
Oct 30 14:33:18 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:33:18 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:33:18 user nova-compute[74319]: FIRMWARE:
Oct 30 14:33:18 user nova-compute[74319]: No targets found.
Oct 30 14:33:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:33:18 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:33:18 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:33:18 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:33:18 user nova-compute[74319]:   <source dev="/dev/sdc"/>
Oct 30 14:33:18 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:33:18 user nova-compute[74319]:   <serial>1d6b69cd-301c-442f-bee5-e18e2f4b3b91</serial>
Oct 30 14:33:18 user nova-compute[74319]: </disk>
Oct 30 14:33:18 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1be4d3-c061-4e7e-b1a0-9895ecade9dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223840d-8474-49f6-af4e-73e1c394ad1e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:18 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:18 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e (non-flash)
Oct 30 14:33:18 user nova-compute[74319]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:18 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998544ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a97af4a-56ab-4683-b0f3-a959fd3e9d43]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c712f974-5eff-4bbc-b07c-c49a19f53964]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5063c566-3900-43bf-a7d8-da66f074c0f4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7264549e-89a0-469f-b5bc-01bd6028cdbf]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e123607b-4237-4a12-93df-4e3ae0007aeb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee516997-c4b1-41c8-aca9-0d463651922a]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260]
Oct 30 14:33:18 user nova-compute[74319]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e, portal: 172.16.0.220,3260] successful.
Oct 30 14:33:18 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:18 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8f8aa08-32f3-498b-b4eb-fe4e15917f0e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[861b8798-dbac-4005-a13c-4dbd7600d6a3]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (482ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:33:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Deleting instance files /opt/stack/data/nova/instances/50d1686e-07f5-4664-b060-b0fe314777a6_del
Oct 30 14:33:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Deletion of /opt/stack/data/nova/instances/50d1686e-07f5-4664-b060-b0fe314777a6_del complete
Oct 30 14:33:19 user nova-compute[74319]: INFO nova.compute.manager [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 30 14:33:19 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No VIF found with MAC fa:16:3e:07:a4:29, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-cbb7ac7f-ef08-4dfc-a52b-1efbb969d6f9 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.259s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:19 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Took 0.73 seconds to deallocate network for instance.
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c32257c-9af7-4057-8d57-4b1b57f8feb8 req-fdae42c0-2587-4d38-8387-228c5d034ce0 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-deleted-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:19 user nova-compute[74319]: INFO nova.compute.manager [req-7c32257c-9af7-4057-8d57-4b1b57f8feb8 req-fdae42c0-2587-4d38-8387-228c5d034ce0 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Neutron deleted interface f405977e-8e13-4f21-a77f-279dd7a88361; detaching it from the instance and deleting it from the info cache
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.network.neutron [req-7c32257c-9af7-4057-8d57-4b1b57f8feb8 req-fdae42c0-2587-4d38-8387-228c5d034ce0 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:19 user nova-compute[74319]: DEBUG nova.compute.manager [req-7c32257c-9af7-4057-8d57-4b1b57f8feb8 req-fdae42c0-2587-4d38-8387-228c5d034ce0 service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Detach interface failed, port_id=f405977e-8e13-4f21-a77f-279dd7a88361, reason: Instance 50d1686e-07f5-4664-b060-b0fe314777a6 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] Acquiring lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] Lock "50d1686e-07f5-4664-b060-b0fe314777a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] No waiting events found dispatching network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:20 user nova-compute[74319]: WARNING nova.compute.manager [req-67c647d9-93a3-44db-adce-d88bcd714386 req-ec115e7b-cded-4623-93f9-89623e9bb37a service nova] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Received unexpected event network-vif-plugged-f405977e-8e13-4f21-a77f-279dd7a88361 for instance with vm_state active and task_state deleting.
Oct 30 14:33:20 user nova-compute[74319]: INFO nova.compute.manager [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Took 0.83 seconds to detach 1 volumes for instance.
Oct 30 14:33:20 user nova-compute[74319]: DEBUG nova.compute.manager [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 50d1686e-07f5-4664-b060-b0fe314777a6] Deleting volume: f8f8aa08-32f3-498b-b4eb-fe4e15917f0e {{(pid=74319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:33:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:21 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance 50d1686e-07f5-4664-b060-b0fe314777a6
Oct 30 14:33:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-77849afb-07d4-4b4a-831c-dae4a4eb942b tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "50d1686e-07f5-4664-b060-b0fe314777a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.363s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing instance network info cache due to event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:33:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:33:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:33:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:33:32 user nova-compute[74319]: DEBUG nova.network.neutron [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updated VIF entry in instance network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:33:32 user nova-compute[74319]: DEBUG nova.network.neutron [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-51e29a33-0ceb-4023-83e0-ffdddaafd75d req-38127ca7-d624-4244-bbf0-e6b8deeed2d0 service nova] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing instance network info cache due to event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:33:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:33:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updated VIF entry in instance network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:33:34 user nova-compute[74319]: DEBUG nova.network.neutron [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1647e051-3041-4b04-8388-1ba17024be76 req-f3b454f8-ad2c-473a-9cbd-022e33e31c02 service nova] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:33:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:45 user nova-compute[74319]: INFO nova.compute.manager [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Rebooting instance
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:33:45 user nova-compute[74319]: INFO nova.compute.manager [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Unrescuing
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:33:45 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.network.neutron [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.objects.instance [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'flavor' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:46 user nova-compute[74319]: WARNING nova.compute.manager [req-12a7d733-82b6-461d-8888-18deee051786 req-8d241461-a4c4-427d-a8ee-f3dfd24242cc service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance destroyed successfully.
Oct 30 14:33:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance destroyed successfully.
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'resources' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:33:47Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de22b55-0a, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f316e7e7-aa5e-4be2-b9af-68a3661eb65a) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:47 user nova-compute[74319]: INFO os_vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a')
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:33:47 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ee52b-c030-42c0-bbe8-1f533853b9b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:33:47 user nova-compute[74319]: No targets found.
Oct 30 14:33:47 user nova-compute[74319]: iSNS:
Oct 30 14:33:47 user nova-compute[74319]: No targets found.
Oct 30 14:33:47 user nova-compute[74319]: STATIC:
Oct 30 14:33:47 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6
Oct 30 14:33:47 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:33:47 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:33:47 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91
Oct 30 14:33:47 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:33:47 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:33:47 user nova-compute[74319]: FIRMWARE:
Oct 30 14:33:47 user nova-compute[74319]: No targets found.
Oct 30 14:33:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:33:47 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:33:47 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fbb5ca-2aa4-4053-ab02-e8c587fe81ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[292f123f-83c5-4638-b022-63bb10047f9e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:47 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:47 user nova-compute[74319]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9745175b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9bace5-3c70-460d-b9e6-bc0bcfb426ea]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d465178-b23e-49c6-b89a-7057fd0e4a87]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3974fb9c-78d9-486b-be29-6fc1aae8d90b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[babaa95c-b847-4fe2-8aac-26ce8f31cbe2]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad92dc59-7ee7-426b-b6e1-fa630d773e3c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0976a25-92db-430a-802b-d07773c39418]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]
Oct 30 14:33:47 user nova-compute[74319]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.
Oct 30 14:33:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c43818-1030-43b5-9da6-fd37486af4f5]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== disconnect_volume: return (332ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:33:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start _get_guest_xml network_info=[{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'attachment_id': '61e6cdce-b51b-47d2-a095-3d9f4b0dde1d', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5a99c1a5-f267-4469-8800-a8ff0166645b', 'attached_at': '', 'detached_at': '', 'volume_id': '1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'serial': '1d6b69cd-301c-442f-bee5-e18e2f4b3b91'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.objects.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Object Instance<5a99c1a5-f267-4469-8800-a8ff0166645b> lazy-loaded attributes: resources,vcpu_model {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:33:48 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ac94a0-306c-424c-97b3-45bf3f794e83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:33:48 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafe3319-d24b-4cc7-8c50-3fa362844833]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91] added
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a24b91d-91b0-4f0c-898e-d5592145cc6e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1574f5b-281a-43e0-8216-38900cf69f9a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVkItCBp {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EVkItCBp" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecea7fd5-bf42-4c37-a8ed-6f5c6995de71]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EVkItCBp'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a4120a-849b-4138-9e47-88d3977fe3cb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe6759-a4f9-4d9d-8e66-7e9df628d3af]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d327ff-31f6-4f38-a3c6-46e7715efbfa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]
Oct 30 14:33:48 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0246ede-56f5-44ff-a34e-97f139f6c517]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e58ed1-bd0c-4a6a-ae72-80e57cbae1b1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:33:48 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a7e48-7f14-4673-91f1-54fb5f58bc1f]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:48 user nova-compute[74319]: WARNING nova.compute.manager [req-62cbcb49-cbb9-49e9-bc8c-e916db27f702 req-104ca820-ad19-4895-9380-9c63bcc345c9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26562386663663035', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562386663663035', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:33:47Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.objects.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Object Instance<5a99c1a5-f267-4469-8800-a8ff0166645b> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:33:49 user nova-compute[74319]:   <uuid>5a99c1a5-f267-4469-8800-a8ff0166645b</uuid>
Oct 30 14:33:49 user nova-compute[74319]:   <name>instance-0000002e</name>
Oct 30 14:33:49 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:33:49 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:33:49 user nova-compute[74319]:   <metadata>
Oct 30 14:33:49 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:33:49 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:name>tempest-TestMinimumBasicScenario-server-1934002999</nova:name>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:33:48</nova:creationTime>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:33:49 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:33:49 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:owner>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:user uuid="9fa7c62635fb42cc9044888540c59def">tempest-TestMinimumBasicScenario-382480661-project-member</nova:user>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:project uuid="5a47d65c914c4872916c84cc42b46768">tempest-TestMinimumBasicScenario-382480661</nova:project>
Oct 30 14:33:49 user nova-compute[74319]:       </nova:owner>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:root type="image" uuid="a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0"/>
Oct 30 14:33:49 user nova-compute[74319]:       <nova:ports>
Oct 30 14:33:49 user nova-compute[74319]:         <nova:port uuid="3de22b55-0afb-4c90-b8bb-528093ae43df">
Oct 30 14:33:49 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 30 14:33:49 user nova-compute[74319]:         </nova:port>
Oct 30 14:33:49 user nova-compute[74319]:       </nova:ports>
Oct 30 14:33:49 user nova-compute[74319]:     </nova:instance>
Oct 30 14:33:49 user nova-compute[74319]:   </metadata>
Oct 30 14:33:49 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:33:49 user nova-compute[74319]:     <system>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="serial">5a99c1a5-f267-4469-8800-a8ff0166645b</entry>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="uuid">5a99c1a5-f267-4469-8800-a8ff0166645b</entry>
Oct 30 14:33:49 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:33:49 user nova-compute[74319]:     </system>
Oct 30 14:33:49 user nova-compute[74319]:   </sysinfo>
Oct 30 14:33:49 user nova-compute[74319]:   <os>
Oct 30 14:33:49 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:33:49 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:33:49 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:33:49 user nova-compute[74319]:   </os>
Oct 30 14:33:49 user nova-compute[74319]:   <features>
Oct 30 14:33:49 user nova-compute[74319]:     <acpi/>
Oct 30 14:33:49 user nova-compute[74319]:     <apic/>
Oct 30 14:33:49 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:33:49 user nova-compute[74319]:   </features>
Oct 30 14:33:49 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:33:49 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:33:49 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:33:49 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:33:49 user nova-compute[74319]:   </clock>
Oct 30 14:33:49 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:33:49 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:33:49 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:33:49 user nova-compute[74319]:   </cpu>
Oct 30 14:33:49 user nova-compute[74319]:   <devices>
Oct 30 14:33:49 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:33:49 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:33:49 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk"/>
Oct 30 14:33:49 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:33:49 user nova-compute[74319]:     </disk>
Oct 30 14:33:49 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:33:49 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:33:49 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:33:49 user nova-compute[74319]:       <target dev="vdb" bus="virtio"/>
Oct 30 14:33:49 user nova-compute[74319]:       <serial>1d6b69cd-301c-442f-bee5-e18e2f4b3b91</serial>
Oct 30 14:33:49 user nova-compute[74319]:     </disk>
Oct 30 14:33:49 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:33:49 user nova-compute[74319]:       <mac address="fa:16:3e:07:a4:29"/>
Oct 30 14:33:49 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:33:49 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:33:49 user nova-compute[74319]:       <target dev="tap3de22b55-0a"/>
Oct 30 14:33:49 user nova-compute[74319]:     </interface>
Oct 30 14:33:49 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:33:49 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/console.log" append="off"/>
Oct 30 14:33:49 user nova-compute[74319]:     </serial>
Oct 30 14:33:49 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:33:49 user nova-compute[74319]:     <video>
Oct 30 14:33:49 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:33:49 user nova-compute[74319]:     </video>
Oct 30 14:33:49 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:33:49 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:33:49 user nova-compute[74319]:     </rng>
Oct 30 14:33:49 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:33:49 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:33:49 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:33:49 user nova-compute[74319]:     </memballoon>
Oct 30 14:33:49 user nova-compute[74319]:   </devices>
Oct 30 14:33:49 user nova-compute[74319]: </domain>
Oct 30 14:33:49 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.objects.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Object Instance<5a99c1a5-f267-4469-8800-a8ff0166645b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/721b6c0440e527516e6f38430a5a2f9fb7f87df4 --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:33:49 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Cannot resize image /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'migration_context' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.objects.base [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Object Instance<5a99c1a5-f267-4469-8800-a8ff0166645b> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74319) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:33:47Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG os_vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4821bf62-3f94-5991-858d-29b30b7a699b', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de22b55-0a, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de22b55-0a, col_values=(('qos', UUID('9b1e916f-af77-4683-b16e-33aa8b2c1cc5')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de22b55-0a, col_values=(('external_ids', {'iface-id': '3de22b55-0afb-4c90-b8bb-528093ae43df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:a4:29', 'vm-uuid': '5a99c1a5-f267-4469-8800-a8ff0166645b'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:50 user nova-compute[74319]: INFO os_vif [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a')
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:50 user nova-compute[74319]: WARNING nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:50 user nova-compute[74319]: WARNING nova.compute.manager [req-239544b4-e971-428e-9ab2-b65b9f0cabc7 req-43cd3ca1-1c1e-43b1-a2eb-3c62ebfabc46 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state rescued and task_state unrescuing.
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:50 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:33:51 user nova-compute[74319]: DEBUG nova.compute.manager [None req-3f3274d8-378f-43d2-9ca4-f810dea0d635 tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:33:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:52 user nova-compute[74319]: WARNING nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:33:52 user nova-compute[74319]: WARNING nova.compute.manager [req-c3a6dc13-82e3-481e-9622-e0a7535ad44d req-8d9d0ac3-b8d3-455e-836f-16ac35e08fc3 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state active and task_state reboot_started_hard.
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:33:53 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance rebooted successfully.
Oct 30 14:33:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:33:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5d75cce9-63dc-4fba-a81e-3b625b1e0cb4 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.584s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:33:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:33:54 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8749MB free_disk=25.045799255371094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a99c1a5-f267-4469-8800-a8ff0166645b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:33:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:33:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:33:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:33:58 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:34:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:34:28 user nova-compute[74319]: INFO nova.compute.claims [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Claim successful on node user
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:34:28 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.policy [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:34:28 user nova-compute[74319]: INFO nova.virt.block_device [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Booting with volume edebc7bc-49b8-4e5a-9690-bcc8045d67da at /dev/vda
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.utils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c2170c-a9c0-4eed-ae70-10a43768e05f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe127ff3-3ac6-45b4-adb5-4c94f0bdb198]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8a0ee3-00c1-4192-8379-30163eb95c07]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a4169c-7616-4d30-bbe8-4f7de7b3a3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:34:28 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:34:28 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf0fbc-5ff4-4c4a-9fb9-133ddf86b14d]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG os_brick.utils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:34:28 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating existing volume attachment record: 860b2a24-8cac-4096-b801-a338e526071c {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:34:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Successfully created port: 7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Successfully updated port: 7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-changed-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Refreshing instance network info cache due to event network-changed-7b9e81a3-b2d7-4360-9ecd-cb3481821831. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] Acquiring lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating instance_info_cache with network_info: [{"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Instance network_info: |[{"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] Acquired lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Refreshing network info cache for port 7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updated VIF entry in instance network info cache for port 7b9e81a3-b2d7-4360-9ecd-cb3481821831. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating instance_info_cache with network_info: [{"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:34:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-69a2914f-02a5-4666-ae4d-2ce6d9bdff65 req-2b509328-423b-4b59-ab37-91320162a819 service nova] Releasing lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:34:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:34:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:34:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Creating image(s)
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Ensure instance console log exists: /opt/stack/data/nova/instances/ae35b586-e9f8-4bb0-8a5f-e30813ab717d/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Start _get_guest_xml network_info=[{"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '860b2a24-8cac-4096-b801-a338e526071c', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae35b586-e9f8-4bb0-8a5f-e30813ab717d', 'attached_at': '', 'detached_at': '', 'volume_id': 'edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'serial': 'edebc7bc-49b8-4e5a-9690-bcc8045d67da'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:34:47 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:34:47 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:34:47 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:34:47 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:34:47 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef018b8-471d-4d48-934a-5a375819732f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:34:47 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b7c8c-ffc9-4787-ad38-9df0a60cdad2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da] added
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fa62d-343f-476d-867c-9c3411f410c1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f78257d-2afe-484a-8dac-64a85f42fecb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrBNevHT {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrBNevHT" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab64230-48ab-4008-94d9-4f62c126f16f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrBNevHT'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[320409b4-9646-4317-8c3c-fe6dffa04b32]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f896b0d7-deaa-4d87-b2e4-50d4730de39e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d6f02f-13ab-401b-af25-17095f7e0d07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]
Oct 30 14:34:47 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9de4b4-5bd2-44d8-a0e2-4ce90c331fca]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c88d674-3d8e-4465-899d-5b6427c85db4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:34:47 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:34:47 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[af541bea-0b25-47a9-9796-2b0b2c6f1812]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:34:47 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:34:48 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:34:48 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26133336666303638', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:34:48 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133336666303638', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-329575644',display_name='tempest-TestVolumeBootPattern-server-329575644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-329575644',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-slqbdpeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:34:29Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=ae35b586-e9f8-4bb0-8a5f-e30813ab717d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.objects.instance [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid ae35b586-e9f8-4bb0-8a5f-e30813ab717d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:34:49 user nova-compute[74319]:   <uuid>ae35b586-e9f8-4bb0-8a5f-e30813ab717d</uuid>
Oct 30 14:34:49 user nova-compute[74319]:   <name>instance-0000002f</name>
Oct 30 14:34:49 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:34:49 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:34:49 user nova-compute[74319]:   <metadata>
Oct 30 14:34:49 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:34:49 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:34:49 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-server-329575644</nova:name>
Oct 30 14:34:49 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:34:47</nova:creationTime>
Oct 30 14:34:49 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:34:49 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:34:49 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:34:49 user nova-compute[74319]:       <nova:owner>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:34:49 user nova-compute[74319]:       </nova:owner>
Oct 30 14:34:49 user nova-compute[74319]:       <nova:ports>
Oct 30 14:34:49 user nova-compute[74319]:         <nova:port uuid="7b9e81a3-b2d7-4360-9ecd-cb3481821831">
Oct 30 14:34:49 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 30 14:34:49 user nova-compute[74319]:         </nova:port>
Oct 30 14:34:49 user nova-compute[74319]:       </nova:ports>
Oct 30 14:34:49 user nova-compute[74319]:     </nova:instance>
Oct 30 14:34:49 user nova-compute[74319]:   </metadata>
Oct 30 14:34:49 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:34:49 user nova-compute[74319]:     <system>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="serial">ae35b586-e9f8-4bb0-8a5f-e30813ab717d</entry>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="uuid">ae35b586-e9f8-4bb0-8a5f-e30813ab717d</entry>
Oct 30 14:34:49 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:34:49 user nova-compute[74319]:     </system>
Oct 30 14:34:49 user nova-compute[74319]:   </sysinfo>
Oct 30 14:34:49 user nova-compute[74319]:   <os>
Oct 30 14:34:49 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:34:49 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:34:49 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:34:49 user nova-compute[74319]:   </os>
Oct 30 14:34:49 user nova-compute[74319]:   <features>
Oct 30 14:34:49 user nova-compute[74319]:     <acpi/>
Oct 30 14:34:49 user nova-compute[74319]:     <apic/>
Oct 30 14:34:49 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:34:49 user nova-compute[74319]:   </features>
Oct 30 14:34:49 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:34:49 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:34:49 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:34:49 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:34:49 user nova-compute[74319]:   </clock>
Oct 30 14:34:49 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:34:49 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:34:49 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:34:49 user nova-compute[74319]:   </cpu>
Oct 30 14:34:49 user nova-compute[74319]:   <devices>
Oct 30 14:34:49 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:34:49 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:34:49 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:34:49 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:34:49 user nova-compute[74319]:       <serial>edebc7bc-49b8-4e5a-9690-bcc8045d67da</serial>
Oct 30 14:34:49 user nova-compute[74319]:     </disk>
Oct 30 14:34:49 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:34:49 user nova-compute[74319]:       <mac address="fa:16:3e:31:5f:90"/>
Oct 30 14:34:49 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:34:49 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:34:49 user nova-compute[74319]:       <target dev="tap7b9e81a3-b2"/>
Oct 30 14:34:49 user nova-compute[74319]:     </interface>
Oct 30 14:34:49 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:34:49 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/ae35b586-e9f8-4bb0-8a5f-e30813ab717d/console.log" append="off"/>
Oct 30 14:34:49 user nova-compute[74319]:     </serial>
Oct 30 14:34:49 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:34:49 user nova-compute[74319]:     <video>
Oct 30 14:34:49 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:34:49 user nova-compute[74319]:     </video>
Oct 30 14:34:49 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:34:49 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:34:49 user nova-compute[74319]:     </rng>
Oct 30 14:34:49 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:34:49 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:34:49 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:34:49 user nova-compute[74319]:     </memballoon>
Oct 30 14:34:49 user nova-compute[74319]:   </devices>
Oct 30 14:34:49 user nova-compute[74319]: </domain>
Oct 30 14:34:49 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-329575644',display_name='tempest-TestVolumeBootPattern-server-329575644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-329575644',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-slqbdpeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:34:29Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=ae35b586-e9f8-4bb0-8a5f-e30813ab717d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG os_vif [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '042e4c3f-0935-579b-956c-3cb650d04521', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b9e81a3-b2, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b9e81a3-b2, col_values=(('qos', UUID('5ee73784-20ec-47cf-bc10-2012e2790160')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b9e81a3-b2, col_values=(('external_ids', {'iface-id': '7b9e81a3-b2d7-4360-9ecd-cb3481821831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:5f:90', 'vm-uuid': 'ae35b586-e9f8-4bb0-8a5f-e30813ab717d'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:49 user nova-compute[74319]: INFO os_vif [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2')
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:34:49 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:31:5f:90, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] No waiting events found dispatching network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:34:50 user nova-compute[74319]: WARNING nova.compute.manager [req-5e4aca9b-db26-4991-b7be-734b3a18ccde req-ccc328a8-e933-4f31-9f11-cc7aea44051d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received unexpected event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 for instance with vm_state building and task_state spawning.
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:34:52 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Instance spawned successfully.
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:34:52 user nova-compute[74319]: INFO nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Took 5.00 seconds to spawn the instance on the hypervisor.
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.compute.manager [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] No waiting events found dispatching network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:34:52 user nova-compute[74319]: WARNING nova.compute.manager [req-754f9d83-61db-4daf-be29-ed24037ec155 req-3aaca8d1-dcbc-40c6-97eb-c8b8fc66e30a service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received unexpected event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 for instance with vm_state building and task_state spawning.
Oct 30 14:34:52 user nova-compute[74319]: INFO nova.compute.manager [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Took 24.28 seconds to build instance.
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-8429b344-dc90-4e82-a192-9ff11c9e98d2 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.374s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:52 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:34:53 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:34:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:34:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:34:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8544MB free_disk=25.034908294677734GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a99c1a5-f267-4469-8800-a8ff0166645b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae35b586-e9f8-4bb0-8a5f-e30813ab717d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:34:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:34:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:57 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:34:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:34:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:34:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [{"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9069a745-a232-47f6-b6a3-cde3ba8c8afb" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:35:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:35:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing instance network info cache due to event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing instance network info cache due to event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG nova.network.neutron [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:35:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:35:37 user nova-compute[74319]: INFO nova.compute.manager [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Detaching volume edd9f80c-8bc6-477b-8201-ecc4526d6eb6
Oct 30 14:35:38 user nova-compute[74319]: INFO nova.virt.block_device [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Attempting to driver detach volume edd9f80c-8bc6-477b-8201-ecc4526d6eb6 from mountpoint /dev/vdb
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Attempting to detach device vdb from instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:35:38 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:35:38 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:35:38 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:35:38 user nova-compute[74319]:   <serial>edd9f80c-8bc6-477b-8201-ecc4526d6eb6</serial>
Oct 30 14:35:38 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:35:38 user nova-compute[74319]: </disk>
Oct 30 14:35:38 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:35:38 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully detached device vdb from instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 from the persistent domain config.
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:35:38 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:35:38 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:35:38 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:35:38 user nova-compute[74319]:   <serial>edd9f80c-8bc6-477b-8201-ecc4526d6eb6</serial>
Oct 30 14:35:38 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:35:38 user nova-compute[74319]: </disk>
Oct 30 14:35:38 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated VIF entry in instance network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-9213e471-8475-4ef2-abb9-eba58354d2b3 req-943a9b71-7426-4c68-ab1c-641e11e5990f service nova] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updated VIF entry in instance network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-45c9e431-fc00-4ec2-88c7-5fedd31ed5a3 req-f55ef989-46f9-4826-a992-e4dfbffb6a78 service nova] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing instance network info cache due to event network-changed-3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] Acquiring lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] Acquired lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:35:38 user nova-compute[74319]: DEBUG nova.network.neutron [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Refreshing network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:35:39 user nova-compute[74319]: INFO nova.compute.manager [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Detaching volume 1d6b69cd-301c-442f-bee5-e18e2f4b3b91
Oct 30 14:35:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:39 user nova-compute[74319]: INFO nova.virt.block_device [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Attempting to driver detach volume 1d6b69cd-301c-442f-bee5-e18e2f4b3b91 from mountpoint /dev/vdb
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Attempting to detach device vdb from instance 5a99c1a5-f267-4469-8800-a8ff0166645b from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:35:39 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:35:39 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:35:39 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:35:39 user nova-compute[74319]:   <serial>1d6b69cd-301c-442f-bee5-e18e2f4b3b91</serial>
Oct 30 14:35:39 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:35:39 user nova-compute[74319]: </disk>
Oct 30 14:35:39 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:35:39 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully detached device vdb from instance 5a99c1a5-f267-4469-8800-a8ff0166645b from the persistent domain config.
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a99c1a5-f267-4469-8800-a8ff0166645b from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:35:39 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:35:39 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:35:39 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:35:39 user nova-compute[74319]:   <serial>1d6b69cd-301c-442f-bee5-e18e2f4b3b91</serial>
Oct 30 14:35:39 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 30 14:35:39 user nova-compute[74319]: </disk>
Oct 30 14:35:39 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updated VIF entry in instance network info cache for port 3de22b55-0afb-4c90-b8bb-528093ae43df. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [{"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc231e3f-f5c7-4e56-b9ff-57011e33aabc req-0a7e8fb2-7d55-474b-a768-a2a75d1b66f9 service nova] Releasing lock "refresh_cache-5a99c1a5-f267-4469-8800-a8ff0166645b" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing instance network info cache due to event network-changed-9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Refreshing network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated VIF entry in instance network info cache for port 9581932a-46b2-453b-a25f-9efc0e632d0e. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:35:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-a11ec84a-e3dd-49a1-83bd-05b0dc8e6694 req-02ab2015-0aa6-42d7-b583-8df4988186db service nova] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:35:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:35:49 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:35:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:35:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:35:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:35:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:35:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=25.03388214111328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 5a99c1a5-f267-4469-8800-a8ff0166645b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance ae35b586-e9f8-4bb0-8a5f-e30813ab717d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:35:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.267s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:35:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 is timed out.
Oct 30 14:35:58 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully detached device vdb from instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381 from the live domain config.
Oct 30 14:35:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vdCVOLDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:35:58 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5bcdc7-7e31-4b3a-b792-2027590c0684]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:35:58 user nova-compute[74319]: No targets found.
Oct 30 14:35:58 user nova-compute[74319]: iSNS:
Oct 30 14:35:58 user nova-compute[74319]: No targets found.
Oct 30 14:35:58 user nova-compute[74319]: STATIC:
Oct 30 14:35:58 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6
Oct 30 14:35:58 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:35:58 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:35:58 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:35:58 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:35:58 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:35:58 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91
Oct 30 14:35:58 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:35:58 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:35:58 user nova-compute[74319]: FIRMWARE:
Oct 30 14:35:58 user nova-compute[74319]: No targets found.
Oct 30 14:35:58 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:35:58 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:35:58 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[164b9219-5e56-4b55-a23a-6d2ddd17db92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7f635d-0bfb-4c90-b0e4-a42bdfbbc010]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:35:58 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:35:58 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:35:58 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 (non-flash)
Oct 30 14:35:58 user nova-compute[74319]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:35:58 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:35:58 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998546e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f41428-d54e-4a2f-8001-5bf26584f617]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e059c56-2358-4409-9d2c-47c5233ba067]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac439c4-e849-434b-8d3d-b84e1d5bf38f]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbddc38-6614-4b4e-b196-358009db77d7]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526a22e-82ac-4fb2-99db-5317e8a26a35]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eaca46-97fe-484a-8e33-1d26f745b4ac]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260]
Oct 30 14:35:58 user nova-compute[74319]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6, portal: 172.16.0.220,3260] successful.
Oct 30 14:35:58 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edd9f80c-8bc6-477b-8201-ecc4526d6eb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b2cd4a-d313-40a3-92c4-66d10d23df02]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] <== disconnect_volume: return (304ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:35:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG nova.objects.instance [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'flavor' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:35:59 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a99c1a5-f267-4469-8800-a8ff0166645b is timed out.
Oct 30 14:35:59 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully detached device vdb from instance 5a99c1a5-f267-4469-8800-a8ff0166645b from the live domain config.
Oct 30 14:35:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EVkItCBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:35:59 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dc3df4d2-e72a-4370-99c8-203dcf6407ea tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.681s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb583541-3f4b-46aa-9018-b23750727c37]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:35:59 user nova-compute[74319]: No targets found.
Oct 30 14:35:59 user nova-compute[74319]: iSNS:
Oct 30 14:35:59 user nova-compute[74319]: No targets found.
Oct 30 14:35:59 user nova-compute[74319]: STATIC:
Oct 30 14:35:59 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:35:59 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:35:59 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:35:59 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91
Oct 30 14:35:59 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:35:59 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:35:59 user nova-compute[74319]: FIRMWARE:
Oct 30 14:35:59 user nova-compute[74319]: No targets found.
Oct 30 14:35:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:35:59 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:35:59 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332d682-407c-4e80-87aa-64176c8800dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0760cbd5-b518-4d45-bc72-b8dbe967c02c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:35:59 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:35:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 (non-flash)
Oct 30 14:35:59 user nova-compute[74319]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:35:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974682170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[193ebcd2-7fd0-46f9-8b45-29f337f06f5c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cdb18c-c260-44c0-80c2-3cac6e3ea5c9]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8b64f2-cd60-4596-8e15-db598aaade1e]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77452b0-4c59-4359-93f0-c89c329c70a2]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66f3d62-059c-4267-ac74-9cbb57f0221d]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f323c0-7c99-450b-9e4a-d1114f7a736d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260]
Oct 30 14:35:59 user nova-compute[74319]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91, portal: 172.16.0.220,3260] successful.
Oct 30 14:35:59 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1d6b69cd-301c-442f-bee5-e18e2f4b3b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a9eac8f-39a1-4acf-9591-8eb5902bc9fb]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== disconnect_volume: return (325ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:35:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [{"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-ae74b260-4f66-4117-8cfa-9fa9bbcaa381" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:36:00 user nova-compute[74319]: DEBUG nova.objects.instance [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:36:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-451ecd95-bcd5-4f9f-974e-206544bea0ed tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.967s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:36:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:36:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:17 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:36:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-changed-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.compute.manager [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Refreshing instance network info cache due to event network-changed-7b9e81a3-b2d7-4360-9ecd-cb3481821831. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] Acquiring lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] Acquired lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Refreshing network info cache for port 7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updated VIF entry in instance network info cache for port 7b9e81a3-b2d7-4360-9ecd-cb3481821831. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.network.neutron [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating instance_info_cache with network_info: [{"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6cd8faff-8fc8-485a-ae9a-cddd4ae8947f req-dfb869fb-c95f-411c-83c8-b25411f37f5d service nova] Releasing lock "refresh_cache-ae35b586-e9f8-4bb0-8a5f-e30813ab717d" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:20 user nova-compute[74319]: INFO nova.compute.manager [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Terminating instance
Oct 30 14:36:20 user nova-compute[74319]: DEBUG nova.compute.manager [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-unplugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] No waiting events found dispatching network-vif-unplugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.compute.manager [req-5b9a36dd-62a7-4e7e-b9e9-a445f9b57958 req-f05ce799-a0ba-4ee2-b905-3841dec003df service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-unplugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Instance destroyed successfully.
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.objects.instance [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid ae35b586-e9f8-4bb0-8a5f-e30813ab717d {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-329575644',display_name='tempest-TestVolumeBootPattern-server-329575644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-329575644',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:34:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-slqbdpeh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:34:53Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=ae35b586-e9f8-4bb0-8a5f-e30813ab717d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "address": "fa:16:3e:31:5f:90", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.149", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b9e81a3-b2", "ovs_interfaceid": "7b9e81a3-b2d7-4360-9ecd-cb3481821831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_vif [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b9e81a3-b2, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ee73784-20ec-47cf-bc10-2012e2790160) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:21 user nova-compute[74319]: INFO os_vif [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:5f:90,bridge_name='br-int',has_traffic_filtering=True,id=7b9e81a3-b2d7-4360-9ecd-cb3481821831,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b9e81a3-b2')
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:36:21 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e89898-77e9-40b8-a468-7a2d801f2a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:36:21 user nova-compute[74319]: No targets found.
Oct 30 14:36:21 user nova-compute[74319]: iSNS:
Oct 30 14:36:21 user nova-compute[74319]: No targets found.
Oct 30 14:36:21 user nova-compute[74319]: STATIC:
Oct 30 14:36:21 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:36:21 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:36:21 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:36:21 user nova-compute[74319]: FIRMWARE:
Oct 30 14:36:21 user nova-compute[74319]: No targets found.
Oct 30 14:36:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:36:21 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:36:21 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ebdc15-335f-45f1-bef4-bb404d968740]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a890df-bcb2-4e79-affb-891f771f61b8]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:36:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:36:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998544ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30baca5-22fe-4963-97a8-e5d64ef01b3d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2505a410-4904-406b-b50d-b47f5f7ac2be]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9399b634-b29d-43f4-9cbc-3ae7352f1a17]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c745355-bf4e-4314-a804-34c69b224920]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[332879e9-7325-46dc-943d-cdfe87f3599b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d8407-e78a-445d-bfb1-b932719da567]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]
Oct 30 14:36:21 user nova-compute[74319]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.
Oct 30 14:36:21 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d35e4c6-8dd9-477f-85d9-2155259446f7]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (285ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:36:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Deleting instance files /opt/stack/data/nova/instances/ae35b586-e9f8-4bb0-8a5f-e30813ab717d_del
Oct 30 14:36:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Deletion of /opt/stack/data/nova/instances/ae35b586-e9f8-4bb0-8a5f-e30813ab717d_del complete
Oct 30 14:36:21 user nova-compute[74319]: INFO nova.compute.manager [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 30 14:36:21 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:36:21 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:36:22 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:22 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Took 0.67 seconds to deallocate network for instance.
Oct 30 14:36:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-1d7918bc-691a-4061-9065-2d3df74b80f8 req-0281811d-477f-46d6-834b-13c3e9c11ab8 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-deleted-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:22 user nova-compute[74319]: INFO nova.compute.manager [req-1d7918bc-691a-4061-9065-2d3df74b80f8 req-0281811d-477f-46d6-834b-13c3e9c11ab8 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Neutron deleted interface 7b9e81a3-b2d7-4360-9ecd-cb3481821831; detaching it from the instance and deleting it from the info cache
Oct 30 14:36:22 user nova-compute[74319]: DEBUG nova.network.neutron [req-1d7918bc-691a-4061-9065-2d3df74b80f8 req-0281811d-477f-46d6-834b-13c3e9c11ab8 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:22 user nova-compute[74319]: DEBUG nova.compute.manager [req-1d7918bc-691a-4061-9065-2d3df74b80f8 req-0281811d-477f-46d6-834b-13c3e9c11ab8 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Detach interface failed, port_id=7b9e81a3-b2d7-4360-9ecd-cb3481821831, reason: Instance ae35b586-e9f8-4bb0-8a5f-e30813ab717d could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] Acquiring lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG nova.compute.manager [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] No waiting events found dispatching network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:23 user nova-compute[74319]: WARNING nova.compute.manager [req-05e7d4a9-08bd-49de-906c-5de9ebcb7ddd req-4dafc31a-fc9c-46a5-a63e-8e066ae04490 service nova] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Received unexpected event network-vif-plugged-7b9e81a3-b2d7-4360-9ecd-cb3481821831 for instance with vm_state active and task_state deleting.
Oct 30 14:36:23 user nova-compute[74319]: INFO nova.compute.manager [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: ae35b586-e9f8-4bb0-8a5f-e30813ab717d] Took 0.82 seconds to detach 1 volumes for instance.
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:23 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance ae35b586-e9f8-4bb0-8a5f-e30813ab717d
Oct 30 14:36:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-07bc1943-c607-45ac-ae3c-47fa3e5be3fa tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "ae35b586-e9f8-4bb0-8a5f-e30813ab717d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.986s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:28 user nova-compute[74319]: INFO nova.compute.manager [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Terminating instance
Oct 30 14:36:28 user nova-compute[74319]: DEBUG nova.compute.manager [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-3a838c68-fdd2-4597-bdd1-620d9946f176 req-a4fd154b-b5fb-4eb4-b2e1-a57777750181 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-unplugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:29 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Instance destroyed successfully.
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.objects.instance [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid ae74b260-4f66-4117-8cfa-9fa9bbcaa381 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-873046480',display_name='tempest-ServerRescueNegativeTestJSON-server-873046480',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-873046480',id=44,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZMCm1WsxEXIU41FFGs09hEQ7/8R29O0sBJYhNrAcJOVGKf5P4nDxLHDfVHkha+nNk0Vem9eFzkvPlF3dCBjRZmbtQys/34fo2W0M80eZw9kl/Nsm4VgLuZ+caKrNSGsA==',key_name='tempest-keypair-1286195557',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:31:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-qwtdfj7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:33:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=ae74b260-4f66-4117-8cfa-9fa9bbcaa381,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "9581932a-46b2-453b-a25f-9efc0e632d0e", "address": "fa:16:3e:9f:57:e4", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9581932a-46", "ovs_interfaceid": "9581932a-46b2-453b-a25f-9efc0e632d0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG os_vif [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9581932a-46, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a6ca225-8a7e-4792-a75c-f599e7977913) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:29 user nova-compute[74319]: INFO os_vif [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:57:e4,bridge_name='br-int',has_traffic_filtering=True,id=9581932a-46b2-453b-a25f-9efc0e632d0e,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9581932a-46')
Oct 30 14:36:29 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Deleting instance files /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381_del
Oct 30 14:36:29 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Deletion of /opt/stack/data/nova/instances/ae74b260-4f66-4117-8cfa-9fa9bbcaa381_del complete
Oct 30 14:36:29 user nova-compute[74319]: INFO nova.compute.manager [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 14:36:29 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:29 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Took 0.65 seconds to deallocate network for instance.
Oct 30 14:36:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a7d2a56-9273-4d38-9c3b-3656cc91baae req-d7929ba0-fb37-45e2-9295-d7078df5a5d2 service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-deleted-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:30 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Deleted allocations for instance ae74b260-4f66-4117-8cfa-9fa9bbcaa381
Oct 30 14:36:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-31f5737f-d19b-4554-9d45-486aec4c928d tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] Acquiring lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] Lock "ae74b260-4f66-4117-8cfa-9fa9bbcaa381-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] No waiting events found dispatching network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:30 user nova-compute[74319]: WARNING nova.compute.manager [req-61c9aa02-4865-42b1-bdb2-0f0b94bd07ff req-5945bc3c-3ce9-41b3-ba7f-26e041f9ddec service nova] [instance: ae74b260-4f66-4117-8cfa-9fa9bbcaa381] Received unexpected event network-vif-plugged-9581932a-46b2-453b-a25f-9efc0e632d0e for instance with vm_state deleted and task_state None.
Oct 30 14:36:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:36:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:40 user nova-compute[74319]: INFO nova.compute.manager [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Terminating instance
Oct 30 14:36:40 user nova-compute[74319]: DEBUG nova.compute.manager [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:40 user nova-compute[74319]: DEBUG nova.compute.manager [req-80558c1c-0dea-4a87-993f-c83c6077893b req-bd96ae6f-8545-4299-a27c-11bd2fa05718 service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-unplugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Instance destroyed successfully.
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.objects.instance [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'resources' on Instance uuid 5a99c1a5-f267-4469-8800-a8ff0166645b {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1934002999',display_name='tempest-TestMinimumBasicScenario-server-1934002999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1934002999',id=46,image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0Yfi6gN5kRVabeB1I1iy1NFYidwYY/6B8eu7JleYP+j060Q0+AYx95zn0aBdV3VuUBVEZFOayaqvYJlXMlRzSkvohri1i4EHo1D3Fc3l9cwsjEArqdH1i7L8XXJOIyEQ==',key_name='tempest-TestMinimumBasicScenario-890908623',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-c5id2ws5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1f494d3-88ba-4a4f-9d90-ccfbe9894ab0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:33:54Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=5a99c1a5-f267-4469-8800-a8ff0166645b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "3de22b55-0afb-4c90-b8bb-528093ae43df", "address": "fa:16:3e:07:a4:29", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de22b55-0a", "ovs_interfaceid": "3de22b55-0afb-4c90-b8bb-528093ae43df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG os_vif [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de22b55-0a, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b1e916f-af77-4683-b16e-33aa8b2c1cc5) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:41 user nova-compute[74319]: INFO os_vif [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:a4:29,bridge_name='br-int',has_traffic_filtering=True,id=3de22b55-0afb-4c90-b8bb-528093ae43df,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de22b55-0a')
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Deleting instance files /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b_del
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Deletion of /opt/stack/data/nova/instances/5a99c1a5-f267-4469-8800-a8ff0166645b_del complete
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.compute.manager [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 30 14:36:41 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Took 0.46 seconds to deallocate network for instance.
Oct 30 14:36:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-6e167a93-5528-4959-a6df-9f1ae8338911 req-7af4f276-ec0d-4f0b-bb07-f3a4c99563cb service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-deleted-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:36:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:41 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Deleted allocations for instance 5a99c1a5-f267-4469-8800-a8ff0166645b
Oct 30 14:36:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-a433da01-fd9b-4125-a81e-5c9c895c1c12 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:36:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] Acquiring lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] Lock "5a99c1a5-f267-4469-8800-a8ff0166645b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:42 user nova-compute[74319]: DEBUG nova.compute.manager [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] No waiting events found dispatching network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:36:42 user nova-compute[74319]: WARNING nova.compute.manager [req-126bc4c1-4bd8-4f5b-8de5-9fb5f2624a34 req-20f0c7ad-cf62-4379-b5ad-751a49feeabe service nova] [instance: 5a99c1a5-f267-4469-8800-a8ff0166645b] Received unexpected event network-vif-plugged-3de22b55-0afb-4c90-b8bb-528093ae43df for instance with vm_state deleted and task_state None.
Oct 30 14:36:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:36:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:53 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:36:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:36:55 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8827MB free_disk=25.0887451171875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:36:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:36:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:36:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:36:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:36:58 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:36:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:37:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:37:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:12 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:37:12 user nova-compute[74319]: INFO nova.compute.claims [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Claim successful on node user
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:37:13 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.policy [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:37:13 user nova-compute[74319]: INFO nova.virt.block_device [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Booting with volume edebc7bc-49b8-4e5a-9690-bcc8045d67da at /dev/vda
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.utils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e393c7-de6f-4bfc-9c2a-afd3a626cb75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29205f1b-08d3-4298-907d-a965f7265a66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[190a7ccb-f16d-454c-9837-e50dd36883dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b6fa9-1a84-4086-9c90-7491b71567be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:37:13 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:37:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[848cef10-1749-4ae3-b8d5-2e79bd81dd9e]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG os_brick.utils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:37:13 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating existing volume attachment record: 4cd015e3-ffdd-4e35-bd54-a81654267212 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Successfully created port: 8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Successfully updated port: 8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.compute.manager [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing instance network info cache due to event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:37:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG nova.network.neutron [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Instance network_info: |[{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updated VIF entry in instance network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:37:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-37021eab-7a5e-4c3e-8ae9-52114825d676 req-14f2c182-d203-45e5-8a07-6fdb6976b5c1 service nova] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:37:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:37:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:37:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Creating image(s)
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Ensure instance console log exists: /opt/stack/data/nova/instances/2f492328-76b0-4443-bec8-eb366a3bccdd/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Start _get_guest_xml network_info=[{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': '4cd015e3-ffdd-4e35-bd54-a81654267212', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f492328-76b0-4443-bec8-eb366a3bccdd', 'attached_at': '', 'detached_at': '', 'volume_id': 'edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'serial': 'edebc7bc-49b8-4e5a-9690-bcc8045d67da'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:37:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:31 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:37:31 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:37:31 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:37:31 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff1b8e-a74f-46e1-9005-c819a8995c50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:37:31 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5873f6-f30b-4495-abbe-d842c8982238]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da] added
Oct 30 14:37:31 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[250250ed-5a5c-433b-ad25-efecfa0665b0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dad1e3-535f-4a0f-811a-bbed20092399]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrBNevHT {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrBNevHT" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6882edd-af05-4a17-8967-83cc654fe850]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrBNevHT'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265b8b6-ab9c-4b6a-bcdc-8839bc27218a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ab5797-a756-4624-ac52-24f425cc776c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:37:32 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:37:32 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:37:32 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:37:32 user nova-compute[74319]: 
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a82cfb1-39d8-4284-b783-7cab9ece9d81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]
Oct 30 14:37:32 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.
Oct 30 14:37:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[575224b3-2e27-4b50-a173-5fc21a7e46d8]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5c426-e1c8-4c9a-90d7-bdca7b6c2006]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:37:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:37:32 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec59fa-8982-45ff-a963-28ead4a38183]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:37:32 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26133336666303638', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133336666303638', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1617039215',display_name='tempest-TestVolumeBootPattern-server-1617039215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1617039215',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-98biuey3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:37:13Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=2f492328-76b0-4443-bec8-eb366a3bccdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.objects.instance [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f492328-76b0-4443-bec8-eb366a3bccdd {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:37:33 user nova-compute[74319]:   <uuid>2f492328-76b0-4443-bec8-eb366a3bccdd</uuid>
Oct 30 14:37:33 user nova-compute[74319]:   <name>instance-00000030</name>
Oct 30 14:37:33 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:37:33 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:37:33 user nova-compute[74319]:   <metadata>
Oct 30 14:37:33 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:37:33 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:37:33 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-server-1617039215</nova:name>
Oct 30 14:37:33 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:37:31</nova:creationTime>
Oct 30 14:37:33 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:37:33 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:37:33 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:37:33 user nova-compute[74319]:       <nova:owner>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:37:33 user nova-compute[74319]:       </nova:owner>
Oct 30 14:37:33 user nova-compute[74319]:       <nova:ports>
Oct 30 14:37:33 user nova-compute[74319]:         <nova:port uuid="8cc06e71-e6d4-4b70-8d3a-666fc6847372">
Oct 30 14:37:33 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 14:37:33 user nova-compute[74319]:         </nova:port>
Oct 30 14:37:33 user nova-compute[74319]:       </nova:ports>
Oct 30 14:37:33 user nova-compute[74319]:     </nova:instance>
Oct 30 14:37:33 user nova-compute[74319]:   </metadata>
Oct 30 14:37:33 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:37:33 user nova-compute[74319]:     <system>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="serial">2f492328-76b0-4443-bec8-eb366a3bccdd</entry>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="uuid">2f492328-76b0-4443-bec8-eb366a3bccdd</entry>
Oct 30 14:37:33 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:37:33 user nova-compute[74319]:     </system>
Oct 30 14:37:33 user nova-compute[74319]:   </sysinfo>
Oct 30 14:37:33 user nova-compute[74319]:   <os>
Oct 30 14:37:33 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:37:33 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:37:33 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:37:33 user nova-compute[74319]:   </os>
Oct 30 14:37:33 user nova-compute[74319]:   <features>
Oct 30 14:37:33 user nova-compute[74319]:     <acpi/>
Oct 30 14:37:33 user nova-compute[74319]:     <apic/>
Oct 30 14:37:33 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:37:33 user nova-compute[74319]:   </features>
Oct 30 14:37:33 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:37:33 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:37:33 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:37:33 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:37:33 user nova-compute[74319]:   </clock>
Oct 30 14:37:33 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:37:33 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:37:33 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:37:33 user nova-compute[74319]:   </cpu>
Oct 30 14:37:33 user nova-compute[74319]:   <devices>
Oct 30 14:37:33 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:37:33 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:37:33 user nova-compute[74319]:       <source dev="/dev/sdb"/>
Oct 30 14:37:33 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:37:33 user nova-compute[74319]:       <serial>edebc7bc-49b8-4e5a-9690-bcc8045d67da</serial>
Oct 30 14:37:33 user nova-compute[74319]:     </disk>
Oct 30 14:37:33 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:37:33 user nova-compute[74319]:       <mac address="fa:16:3e:a9:cf:0c"/>
Oct 30 14:37:33 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:37:33 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:37:33 user nova-compute[74319]:       <target dev="tap8cc06e71-e6"/>
Oct 30 14:37:33 user nova-compute[74319]:     </interface>
Oct 30 14:37:33 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:37:33 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/2f492328-76b0-4443-bec8-eb366a3bccdd/console.log" append="off"/>
Oct 30 14:37:33 user nova-compute[74319]:     </serial>
Oct 30 14:37:33 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:37:33 user nova-compute[74319]:     <video>
Oct 30 14:37:33 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:37:33 user nova-compute[74319]:     </video>
Oct 30 14:37:33 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:37:33 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:37:33 user nova-compute[74319]:     </rng>
Oct 30 14:37:33 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:37:33 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:37:33 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:37:33 user nova-compute[74319]:     </memballoon>
Oct 30 14:37:33 user nova-compute[74319]:   </devices>
Oct 30 14:37:33 user nova-compute[74319]: </domain>
Oct 30 14:37:33 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1617039215',display_name='tempest-TestVolumeBootPattern-server-1617039215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1617039215',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-98biuey3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:37:13Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=2f492328-76b0-4443-bec8-eb366a3bccdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG os_vif [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '063544c4-914d-5496-94d7-675d5fba758c', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cc06e71-e6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cc06e71-e6, col_values=(('qos', UUID('9ce980f8-428a-4bb3-b0d9-d1b519767a30')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cc06e71-e6, col_values=(('external_ids', {'iface-id': '8cc06e71-e6d4-4b70-8d3a-666fc6847372', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:cf:0c', 'vm-uuid': '2f492328-76b0-4443-bec8-eb366a3bccdd'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:33 user nova-compute[74319]: INFO os_vif [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6')
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:37:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:a9:cf:0c, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] No waiting events found dispatching network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:34 user nova-compute[74319]: WARNING nova.compute.manager [req-39654724-8fc5-4c3a-9586-fac0ef5bb140 req-8ad834ba-5789-4b70-99f6-7cd6bdb47667 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received unexpected event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 for instance with vm_state building and task_state spawning.
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:37:35 user nova-compute[74319]: INFO nova.compute.claims [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Claim successful on node user
Oct 30 14:37:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:37:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.policy [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9fa7c62635fb42cc9044888540c59def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a47d65c914c4872916c84cc42b46768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:37:35 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Creating image(s)
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "/opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "/opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.part --force-share --output=json" returned: 0 in 0.381s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG nova.virt.images [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] e1673d86-89b2-45ca-8b5b-fa4805a075e3 was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.part /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Successfully created port: 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.part /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.converted" returned: 0 in 0.231s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:36 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.compute.manager [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] No waiting events found dispatching network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:37 user nova-compute[74319]: WARNING nova.compute.manager [req-ef322cf6-0f17-4037-ae80-17650dfe8b69 req-f2d760e3-bf4a-4158-a6e7-be71a10bf703 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received unexpected event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 for instance with vm_state building and task_state spawning.
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.284s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json" returned: 0 in 0.184s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:37:37 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Instance spawned successfully.
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Successfully updated port: 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json" returned: 0 in 0.194s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373,backing_fmt=raw /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: INFO nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373,backing_fmt=raw /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk 1073741824" returned: 0 in 0.050s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "042fee4b3868397a542ad3fdcddc15ad3a11e373" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:37:37 user nova-compute[74319]: INFO nova.compute.manager [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Took 24.75 seconds to build instance.
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-af831cd2-5b8a-443b-8fdf-3b7645f5c5dd tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.840s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/042fee4b3868397a542ad3fdcddc15ad3a11e373 --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.neutron [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance network_info: |[{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Cannot resize image /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Ensure instance console log exists: /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Start _get_guest_xml network_info=[{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T14:37:32Z,direct_url=<?>,disk_format='qcow2',id=e1673d86-89b2-45ca-8b5b-fa4805a075e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1635011537',owner='5a47d65c914c4872916c84cc42b46768',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T14:37:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e1673d86-89b2-45ca-8b5b-fa4805a075e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:37:37 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:37 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T14:37:32Z,direct_url=<?>,disk_format='qcow2',id=e1673d86-89b2-45ca-8b5b-fa4805a075e3,min_disk=0,min_ram=0,name='tempest-scenario-img--1635011537',owner='5a47d65c914c4872916c84cc42b46768',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T14:37:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671180413',display_name='tempest-TestMinimumBasicScenario-server-671180413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671180413',id=49,image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS5LojPoHmiCGJDJY2XuLnSSSXsNmD6WW48dfl+Xmt1hPxQOupkZcmT1lZS/OoRusullzty49ANxfGhYcx8csGrZSbYRZSG6zdSLhJFNNuwN/Ye83Tk3DrVlrb+SA4uRQ==',key_name='tempest-TestMinimumBasicScenario-1332250423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-qd5glact',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:37:36Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=f7dead57-978f-4268-b841-72cff2fe2d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.objects.instance [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'pci_devices' on Instance uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:37:37 user nova-compute[74319]:   <uuid>f7dead57-978f-4268-b841-72cff2fe2d36</uuid>
Oct 30 14:37:37 user nova-compute[74319]:   <name>instance-00000031</name>
Oct 30 14:37:37 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:37:37 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:37:37 user nova-compute[74319]:   <metadata>
Oct 30 14:37:37 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:37:37 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:name>tempest-TestMinimumBasicScenario-server-671180413</nova:name>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:37:37</nova:creationTime>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:37:37 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:37:37 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:owner>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:user uuid="9fa7c62635fb42cc9044888540c59def">tempest-TestMinimumBasicScenario-382480661-project-member</nova:user>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:project uuid="5a47d65c914c4872916c84cc42b46768">tempest-TestMinimumBasicScenario-382480661</nova:project>
Oct 30 14:37:37 user nova-compute[74319]:       </nova:owner>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:root type="image" uuid="e1673d86-89b2-45ca-8b5b-fa4805a075e3"/>
Oct 30 14:37:37 user nova-compute[74319]:       <nova:ports>
Oct 30 14:37:37 user nova-compute[74319]:         <nova:port uuid="807af7e6-29d4-4e9c-9372-de45c984fc97">
Oct 30 14:37:37 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 30 14:37:37 user nova-compute[74319]:         </nova:port>
Oct 30 14:37:37 user nova-compute[74319]:       </nova:ports>
Oct 30 14:37:37 user nova-compute[74319]:     </nova:instance>
Oct 30 14:37:37 user nova-compute[74319]:   </metadata>
Oct 30 14:37:37 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:37:37 user nova-compute[74319]:     <system>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="serial">f7dead57-978f-4268-b841-72cff2fe2d36</entry>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="uuid">f7dead57-978f-4268-b841-72cff2fe2d36</entry>
Oct 30 14:37:37 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:37:37 user nova-compute[74319]:     </system>
Oct 30 14:37:37 user nova-compute[74319]:   </sysinfo>
Oct 30 14:37:37 user nova-compute[74319]:   <os>
Oct 30 14:37:37 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:37:37 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:37:37 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:37:37 user nova-compute[74319]:   </os>
Oct 30 14:37:37 user nova-compute[74319]:   <features>
Oct 30 14:37:37 user nova-compute[74319]:     <acpi/>
Oct 30 14:37:37 user nova-compute[74319]:     <apic/>
Oct 30 14:37:37 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:37:37 user nova-compute[74319]:   </features>
Oct 30 14:37:37 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:37:37 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:37:37 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:37:37 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:37:37 user nova-compute[74319]:   </clock>
Oct 30 14:37:37 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:37:37 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:37:37 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:37:37 user nova-compute[74319]:   </cpu>
Oct 30 14:37:37 user nova-compute[74319]:   <devices>
Oct 30 14:37:37 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:37:37 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:37:37 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk"/>
Oct 30 14:37:37 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:37:37 user nova-compute[74319]:     </disk>
Oct 30 14:37:37 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:37:37 user nova-compute[74319]:       <mac address="fa:16:3e:95:37:93"/>
Oct 30 14:37:37 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:37:37 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:37:37 user nova-compute[74319]:       <target dev="tap807af7e6-29"/>
Oct 30 14:37:37 user nova-compute[74319]:     </interface>
Oct 30 14:37:37 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:37:37 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/console.log" append="off"/>
Oct 30 14:37:37 user nova-compute[74319]:     </serial>
Oct 30 14:37:37 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:37:37 user nova-compute[74319]:     <video>
Oct 30 14:37:37 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:37:37 user nova-compute[74319]:     </video>
Oct 30 14:37:37 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:37:37 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:37:37 user nova-compute[74319]:     </rng>
Oct 30 14:37:37 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:37:37 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:37:37 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:37:37 user nova-compute[74319]:     </memballoon>
Oct 30 14:37:37 user nova-compute[74319]:   </devices>
Oct 30 14:37:37 user nova-compute[74319]: </domain>
Oct 30 14:37:37 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671180413',display_name='tempest-TestMinimumBasicScenario-server-671180413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671180413',id=49,image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS5LojPoHmiCGJDJY2XuLnSSSXsNmD6WW48dfl+Xmt1hPxQOupkZcmT1lZS/OoRusullzty49ANxfGhYcx8csGrZSbYRZSG6zdSLhJFNNuwN/Ye83Tk3DrVlrb+SA4uRQ==',key_name='tempest-TestMinimumBasicScenario-1332250423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-qd5glact',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:37:36Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=f7dead57-978f-4268-b841-72cff2fe2d36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG os_vif [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '11c130c1-8cd7-515f-a0e9-7b5d2e6e67a4', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap807af7e6-29, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap807af7e6-29, col_values=(('qos', UUID('50ca54d8-9e6f-4b00-88e8-02fdb40200e9')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap807af7e6-29, col_values=(('external_ids', {'iface-id': '807af7e6-29d4-4e9c-9372-de45c984fc97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:37:93', 'vm-uuid': 'f7dead57-978f-4268-b841-72cff2fe2d36'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:37:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:37 user nova-compute[74319]: INFO os_vif [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29')
Oct 30 14:37:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:37:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No VIF found with MAC fa:16:3e:95:37:93, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing instance network info cache due to event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.compute.manager [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:39 user nova-compute[74319]: WARNING nova.compute.manager [req-bc8942ca-7a74-430b-9320-6023f0901ba2 req-afb08019-d09c-4849-a146-032198e13569 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state building and task_state spawning.
Oct 30 14:37:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated VIF entry in instance network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.network.neutron [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3dfb1784-2efe-464f-a3ba-83ca666dab21 req-5332cd4e-bf64-4390-9295-2ffd7734fbca service nova] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:39 user nova-compute[74319]: INFO nova.compute.manager [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Terminating instance
Oct 30 14:37:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Instance destroyed successfully.
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.objects.instance [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid 9069a745-a232-47f6-b6a3-cde3ba8c8afb {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1477593427',display_name='tempest-ServerRescueNegativeTestJSON-server-1477593427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1477593427',id=38,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-xvk1f5n0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:23:01Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9069a745-a232-47f6-b6a3-cde3ba8c8afb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "address": "fa:16:3e:96:7b:26", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f2bacd-f5", "ovs_interfaceid": "96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG os_vif [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f2bacd-f5, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6031555c-5b1e-4e71-a8c1-151595dd0912) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:40 user nova-compute[74319]: INFO os_vif [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:7b:26,bridge_name='br-int',has_traffic_filtering=True,id=96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f2bacd-f5')
Oct 30 14:37:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Deleting instance files /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb_del
Oct 30 14:37:40 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Deletion of /opt/stack/data/nova/instances/9069a745-a232-47f6-b6a3-cde3ba8c8afb_del complete
Oct 30 14:37:40 user nova-compute[74319]: INFO nova.compute.manager [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 14:37:40 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:37:40 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-unplugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Acquiring lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] No waiting events found dispatching network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:41 user nova-compute[74319]: WARNING nova.compute.manager [req-fc1adc47-3b37-485f-87e7-550900fc9620 req-a3f1b78e-f451-41a5-a3bc-0c251be692ab service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received unexpected event network-vif-plugged-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d for instance with vm_state rescued and task_state deleting.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:37:41 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Took 0.41 seconds to deallocate network for instance.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:41 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Deleted allocations for instance 9069a745-a232-47f6-b6a3-cde3ba8c8afb
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:37:41 user nova-compute[74319]: WARNING nova.compute.manager [req-0e656c94-fb05-4a71-9dc0-fe821e3b5fda req-8f0cf310-3c2e-4397-832c-e7e0aaf7f02a service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state building and task_state spawning.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-5ca457bb-34bb-46a2-86af-a86575551b6e tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9069a745-a232-47f6-b6a3-cde3ba8c8afb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.693s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:37:41 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance spawned successfully.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:37:41 user nova-compute[74319]: INFO nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Took 6.09 seconds to spawn the instance on the hypervisor.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:37:41 user nova-compute[74319]: INFO nova.compute.manager [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Took 6.70 seconds to build instance.
Oct 30 14:37:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-68b358cc-c029-4845-914f-46c04e62f92f tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.826s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:43 user nova-compute[74319]: DEBUG nova.compute.manager [req-574950f6-11c4-4d86-aeee-ef4ecdb1af52 req-863d4634-836f-4318-b103-f1abb58152fd service nova] [instance: 9069a745-a232-47f6-b6a3-cde3ba8c8afb] Received event network-vif-deleted-96f2bacd-f5ba-4cb4-97ba-1fd94a631d6d {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:37:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:54 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:54 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:55 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:37:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:56 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8564MB free_disk=25.066741943359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2f492328-76b0-4443-bec8-eb366a3bccdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f7dead57-978f-4268-b841-72cff2fe2d36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:37:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:37:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:37:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:38:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:38:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [{"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-9785d1bd-6e07-40a5-af8d-41eaf909759e" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:38:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:38:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:30 user nova-compute[74319]: INFO nova.compute.manager [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Terminating instance
Oct 30 14:38:30 user nova-compute[74319]: DEBUG nova.compute.manager [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-771488d6-59cc-40db-bfbf-3f5039613d77 req-d62879f6-7145-4a8f-ad20-a30fe0df2dd6 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:38:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Instance destroyed successfully.
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.objects.instance [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lazy-loading 'resources' on Instance uuid 9785d1bd-6e07-40a5-af8d-41eaf909759e {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-515377218',display_name='tempest-ServerRescueNegativeTestJSON-server-515377218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-515377218',id=37,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76e35c5eed5f4e1ab46fbf58a8f7534c',ramdisk_id='',reservation_id='r-0nkuezy1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1158390003',owner_user_name='tempest-ServerRescueNegativeTestJSON-1158390003-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:27:48Z,user_data=None,user_id='2cb6730193bd453fbefe85bfd5e26de2',uuid=9785d1bd-6e07-40a5-af8d-41eaf909759e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converting VIF {"id": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "address": "fa:16:3e:ff:aa:7d", "network": {"id": "b21f94a8-9e82-49fd-98fb-28781afd1b77", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-49028969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76e35c5eed5f4e1ab46fbf58a8f7534c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0aa1859-da", "ovs_interfaceid": "f0aa1859-da9f-4143-8deb-6a8dbb3919cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG os_vif [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0aa1859-da, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ccfa8d75-7875-457e-816c-15555424a3b9) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:31 user nova-compute[74319]: INFO os_vif [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:aa:7d,bridge_name='br-int',has_traffic_filtering=True,id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd,network=Network(b21f94a8-9e82-49fd-98fb-28781afd1b77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0aa1859-da')
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Deleting instance files /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e_del
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Deletion of /opt/stack/data/nova/instances/9785d1bd-6e07-40a5-af8d-41eaf909759e_del complete
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.compute.manager [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 30 14:38:31 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Took 0.47 seconds to deallocate network for instance.
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-ba4e6b67-3a46-4724-8162-268a0debae83 req-a9db85ad-5bd0-4619-bb07-54a3e40508e7 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-deleted-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:31 user nova-compute[74319]: INFO nova.compute.manager [req-ba4e6b67-3a46-4724-8162-268a0debae83 req-a9db85ad-5bd0-4619-bb07-54a3e40508e7 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Neutron deleted interface f0aa1859-da9f-4143-8deb-6a8dbb3919cd; detaching it from the instance and deleting it from the info cache
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.network.neutron [req-ba4e6b67-3a46-4724-8162-268a0debae83 req-a9db85ad-5bd0-4619-bb07-54a3e40508e7 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-ba4e6b67-3a46-4724-8162-268a0debae83 req-a9db85ad-5bd0-4619-bb07-54a3e40508e7 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Detach interface failed, port_id=f0aa1859-da9f-4143-8deb-6a8dbb3919cd, reason: Instance 9785d1bd-6e07-40a5-af8d-41eaf909759e could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Deleted allocations for instance 9785d1bd-6e07-40a5-af8d-41eaf909759e
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-d7512630-5191-44a4-80e0-edef2029cb9c tempest-ServerRescueNegativeTestJSON-1158390003 tempest-ServerRescueNegativeTestJSON-1158390003-project-member] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.720s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:32 user nova-compute[74319]: WARNING nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state deleted and task_state None.
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:32 user nova-compute[74319]: WARNING nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state deleted and task_state None.
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:32 user nova-compute[74319]: WARNING nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state deleted and task_state None.
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:32 user nova-compute[74319]: WARNING nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-unplugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state deleted and task_state None.
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Acquiring lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] Lock "9785d1bd-6e07-40a5-af8d-41eaf909759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] No waiting events found dispatching network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:38:32 user nova-compute[74319]: WARNING nova.compute.manager [req-2008cc5a-219b-4901-be08-10a8b585d9f4 req-5a9a2f95-b305-42d0-a76b-e7c843ed1973 service nova] [instance: 9785d1bd-6e07-40a5-af8d-41eaf909759e] Received unexpected event network-vif-plugged-f0aa1859-da9f-4143-8deb-6a8dbb3919cd for instance with vm_state deleted and task_state None.
Oct 30 14:38:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:38:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:38:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:56 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:38:57 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:38:57 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.092288970947266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2f492328-76b0-4443-bec8-eb366a3bccdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f7dead57-978f-4268-b841-72cff2fe2d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:38:57 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:38:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:38:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.208s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:38:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:39:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG nova.compute.manager [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing instance network info cache due to event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG nova.network.neutron [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updated VIF entry in instance network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG nova.network.neutron [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-03a9c901-820a-491e-bbd5-e39a7d24e655 req-4753917b-ea8b-45c1-89b9-d93628ef1ff8 service nova] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:39:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:39:23 user nova-compute[74319]: INFO nova.compute.claims [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Claim successful on node user
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:39:23 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:39:23 user nova-compute[74319]: INFO nova.virt.block_device [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Booting with volume 48b04e96-ff30-4c85-b72b-704270ed0f9a at /dev/vda
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.policy [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6923e0bb42604a7f81e9c2980aed33f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '090c92eb6b2d4b5987de6989ad9d81f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7b92f-e50b-4cdc-96dd-8fc9fa27184a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b146afd7-c61e-427f-bc9d-b71876773aaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f6ec72-6d0c-4f36-bf75-e901608cfd72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47aaa8c-bdc8-463b-8d71-3c8c6ce2618b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:39:23 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:39:23 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6cf669-2770-44b1-8d18-7a761f39127f]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG os_brick.utils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:39:23 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating existing volume attachment record: f9bf1cc2-ed35-428b-8e32-6eb0f2389476 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:39:24 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Successfully created port: 5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Successfully updated port: 5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquired lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG nova.compute.manager [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing instance network info cache due to event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] Acquiring lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:25 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG nova.network.neutron [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating instance_info_cache with network_info: [{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Releasing lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Instance network_info: |[{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] Acquired lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updated VIF entry in instance network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG nova.network.neutron [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating instance_info_cache with network_info: [{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ab14a83b-9ac9-4e46-9bd2-7553727c4608 req-32d41702-152c-4567-b023-938843081850 service nova] Releasing lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG nova.objects.instance [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:31 user nova-compute[74319]: INFO nova.compute.manager [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Attaching volume 71abcf1f-74c6-433e-bea0-3bd44cedce54 to /dev/vdb
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.utils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bfca72-85af-4bb1-96b8-d5673fabad41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85f5c32-10a6-45f7-b3cb-7aa9ffaee105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a736412d-8cc5-44a7-a9aa-b7709e78c43b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2b044b-ed94-4c3f-98c5-61f17a1d8e62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:39:31 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:39:31 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a32c832-c36c-4544-b79d-4adc619d6871]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG os_brick.utils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:39:31 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating existing volume attachment record: 3689c8aa-d167-4c64-bad6-25dfc52917fe {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:39:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:39:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Creating image(s)
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Did not create local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Ensure instance console log exists: /opt/stack/data/nova/instances/f521f459-e486-49c4-b243-f16741cf9006/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Start _get_guest_xml network_info=[{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'attachment_id': 'f9bf1cc2-ed35-428b-8e32-6eb0f2389476', 'delete_on_termination': False, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPsyCcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f521f459-e486-49c4-b243-f16741cf9006', 'attached_at': '', 'detached_at': '', 'volume_id': '48b04e96-ff30-4c85-b72b-704270ed0f9a', 'serial': '48b04e96-ff30-4c85-b72b-704270ed0f9a'}, 'volume_type': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:39:42 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:39:42 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPsyCcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:39:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:39:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:39:42 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:39:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:39:42 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:39:42 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78fd16a-3b48-41cf-bbe6-db6641022337]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:39:43 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f932a-7198-45ea-88f8-ac8b649dfa99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a] added
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[803fbefb-a0ad-4696-b1ae-f9e7d9e40467]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc35bbae-ce51-448a-878a-6b966cae852c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPsyCcTG {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wPsyCcTG" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[db52a692-b1cc-4654-a1c4-a600e5af0d07]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wPsyCcTG'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e6ca4-7820-4652-a330-567c274266cf]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8133a1d6-3ba6-4a1d-8a1c-800096169d13]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a02494-ff1c-4217-89c6-76ee943adc05]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260]
Oct 30 14:39:43 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260] successful.
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db24d10-5810-46a6-a2f6-2f2e45aaec74]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[90313173-86b1-4577-bc6b-9a3d1c58b350]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:43 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:43 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:43 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[869c4bea-8917-4683-87fe-72da35034d0e]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:43 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPsyCcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23363346432633234', 'path': '/dev/sdc'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363346432633234', 'path': '/dev/sdc'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223750984',display_name='tempest-TestVolumeBootPattern-server-223750984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223750984',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-nlk5zpsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:39:24Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=f521f459-e486-49c4-b243-f16741cf9006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.objects.instance [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'pci_devices' on Instance uuid f521f459-e486-49c4-b243-f16741cf9006 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:39:44 user nova-compute[74319]:   <uuid>f521f459-e486-49c4-b243-f16741cf9006</uuid>
Oct 30 14:39:44 user nova-compute[74319]:   <name>instance-00000032</name>
Oct 30 14:39:44 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:39:44 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:39:44 user nova-compute[74319]:   <metadata>
Oct 30 14:39:44 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:39:44 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:39:44 user nova-compute[74319]:       <nova:name>tempest-TestVolumeBootPattern-server-223750984</nova:name>
Oct 30 14:39:44 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:39:42</nova:creationTime>
Oct 30 14:39:44 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:39:44 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:39:44 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:39:44 user nova-compute[74319]:       <nova:owner>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:user uuid="6923e0bb42604a7f81e9c2980aed33f7">tempest-TestVolumeBootPattern-1283971583-project-member</nova:user>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:project uuid="090c92eb6b2d4b5987de6989ad9d81f9">tempest-TestVolumeBootPattern-1283971583</nova:project>
Oct 30 14:39:44 user nova-compute[74319]:       </nova:owner>
Oct 30 14:39:44 user nova-compute[74319]:       <nova:ports>
Oct 30 14:39:44 user nova-compute[74319]:         <nova:port uuid="5fb9b4d4-417c-4225-8da7-317e9d1b0b82">
Oct 30 14:39:44 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 30 14:39:44 user nova-compute[74319]:         </nova:port>
Oct 30 14:39:44 user nova-compute[74319]:       </nova:ports>
Oct 30 14:39:44 user nova-compute[74319]:     </nova:instance>
Oct 30 14:39:44 user nova-compute[74319]:   </metadata>
Oct 30 14:39:44 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:39:44 user nova-compute[74319]:     <system>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="serial">f521f459-e486-49c4-b243-f16741cf9006</entry>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="uuid">f521f459-e486-49c4-b243-f16741cf9006</entry>
Oct 30 14:39:44 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:39:44 user nova-compute[74319]:     </system>
Oct 30 14:39:44 user nova-compute[74319]:   </sysinfo>
Oct 30 14:39:44 user nova-compute[74319]:   <os>
Oct 30 14:39:44 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:39:44 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:39:44 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:39:44 user nova-compute[74319]:   </os>
Oct 30 14:39:44 user nova-compute[74319]:   <features>
Oct 30 14:39:44 user nova-compute[74319]:     <acpi/>
Oct 30 14:39:44 user nova-compute[74319]:     <apic/>
Oct 30 14:39:44 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:39:44 user nova-compute[74319]:   </features>
Oct 30 14:39:44 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:39:44 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:39:44 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:39:44 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:39:44 user nova-compute[74319]:   </clock>
Oct 30 14:39:44 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:39:44 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:39:44 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:39:44 user nova-compute[74319]:   </cpu>
Oct 30 14:39:44 user nova-compute[74319]:   <devices>
Oct 30 14:39:44 user nova-compute[74319]:     <disk type="block" device="disk">
Oct 30 14:39:44 user nova-compute[74319]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:39:44 user nova-compute[74319]:       <source dev="/dev/sdc"/>
Oct 30 14:39:44 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:39:44 user nova-compute[74319]:       <serial>48b04e96-ff30-4c85-b72b-704270ed0f9a</serial>
Oct 30 14:39:44 user nova-compute[74319]:     </disk>
Oct 30 14:39:44 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:39:44 user nova-compute[74319]:       <mac address="fa:16:3e:69:1c:20"/>
Oct 30 14:39:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:39:44 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:39:44 user nova-compute[74319]:       <target dev="tap5fb9b4d4-41"/>
Oct 30 14:39:44 user nova-compute[74319]:     </interface>
Oct 30 14:39:44 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:39:44 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/f521f459-e486-49c4-b243-f16741cf9006/console.log" append="off"/>
Oct 30 14:39:44 user nova-compute[74319]:     </serial>
Oct 30 14:39:44 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:39:44 user nova-compute[74319]:     <video>
Oct 30 14:39:44 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:39:44 user nova-compute[74319]:     </video>
Oct 30 14:39:44 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:39:44 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:39:44 user nova-compute[74319]:     </rng>
Oct 30 14:39:44 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:39:44 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:39:44 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:39:44 user nova-compute[74319]:     </memballoon>
Oct 30 14:39:44 user nova-compute[74319]:   </devices>
Oct 30 14:39:44 user nova-compute[74319]: </domain>
Oct 30 14:39:44 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223750984',display_name='tempest-TestVolumeBootPattern-server-223750984',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223750984',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-nlk5zpsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:39:24Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=f521f459-e486-49c4-b243-f16741cf9006,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG os_vif [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b21a8df-dc06-57e0-b792-54e72ffca2fa', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fb9b4d4-41, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fb9b4d4-41, col_values=(('qos', UUID('03b14575-5a83-414f-9f38-18d831b3258c')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fb9b4d4-41, col_values=(('external_ids', {'iface-id': '5fb9b4d4-417c-4225-8da7-317e9d1b0b82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:1c:20', 'vm-uuid': 'f521f459-e486-49c4-b243-f16741cf9006'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:44 user nova-compute[74319]: INFO os_vif [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41')
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:39:44 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] No VIF found with MAC fa:16:3e:69:1c:20, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG nova.compute.manager [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:39:45 user nova-compute[74319]: WARNING nova.compute.manager [req-287c8437-f813-4e0e-9aa0-313a77f35ac6 req-9212e9f9-6ef5-4166-9083-718c11ce662d service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state building and task_state spawning.
Oct 30 14:39:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:39:47 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] Instance spawned successfully.
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.compute.manager [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:39:47 user nova-compute[74319]: WARNING nova.compute.manager [req-83d19f9f-5ce7-4e98-a1b6-186bb653f40d req-c405c77c-7274-49a4-b9d9-ed3dc7cf6957 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state building and task_state spawning.
Oct 30 14:39:47 user nova-compute[74319]: INFO nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Took 5.02 seconds to spawn the instance on the hypervisor.
Oct 30 14:39:47 user nova-compute[74319]: DEBUG nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:39:48 user nova-compute[74319]: INFO nova.compute.manager [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Took 24.75 seconds to build instance.
Oct 30 14:39:48 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-4e0b1cd9-0318-4b90-a84f-9af2ea1187c3 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.908s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXNgCrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:39:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:39:51 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:39:51 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a4d02-2b81-4fbc-9cb2-30c294c7121d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:39:51 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9164765b-2d9c-46d8-b007-3b087093dc2a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54] added
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcf6c1a-4753-437c-98a8-c4f5a0f12816]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[df03fdae-df36-44be-af18-c2886410e4df]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqXNgCrO {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqXNgCrO" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[717e54c3-5445-41d4-a358-7f7208cfd98c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqXNgCrO'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b7fe8d-d848-45ed-bbcd-1f551852f6dd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95a55fa-2ebe-40e9-898e-57f64d714357]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a5b6dd-f06e-4f49-a953-d9aee150d744]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260]
Oct 30 14:39:51 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260] successful.
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b1e83-3d68-43f7-b9be-c9c374701d37]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d34d3e-188e-4a71-8bd3-3880297af2e5]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:39:51 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:39:51 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f4568-633d-4610-8f77-6ec6d10757ff]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:39:51 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXNgCrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23435326538623431', 'path': '/dev/sdd'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435326538623431', 'path': '/dev/sdd'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.objects.instance [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:39:52 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:39:52 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:39:52 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:39:52 user nova-compute[74319]:   <serial>71abcf1f-74c6-433e-bea0-3bd44cedce54</serial>
Oct 30 14:39:52 user nova-compute[74319]: </disk>
Oct 30 14:39:52 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] No VIF found with MAC fa:16:3e:95:37:93, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:39:52 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-03fc3749-2910-4805-9bb7-081d07666c19 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.294s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:39:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing instance network info cache due to event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:39:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:55 user nova-compute[74319]: DEBUG nova.network.neutron [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:39:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated VIF entry in instance network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:39:56 user nova-compute[74319]: DEBUG nova.network.neutron [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-938449ec-e27f-48f4-8eb0-5275feae86a9 req-75c98286-bde7-4fc7-8bfa-ad2f735c5637 service nova] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG nova.compute.manager [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing instance network info cache due to event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG nova.network.neutron [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:58 user nova-compute[74319]: INFO nova.compute.manager [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Rebooting instance
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated VIF entry in instance network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.network.neutron [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-28660dc8-1c5f-4dab-98e7-5a0c5f8e3c14 req-5a8289c7-eaa2-48b1-b95f-f66efb2238e8 service nova] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.network.neutron [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:39:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:39:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.080829620361328GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2f492328-76b0-4443-bec8-eb366a3bccdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f7dead57-978f-4268-b841-72cff2fe2d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f521f459-e486-49c4-b243-f16741cf9006 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:39:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG nova.network.neutron [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG nova.compute.manager [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:39:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:00 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:00 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:01 user nova-compute[74319]: DEBUG nova.compute.manager [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:40:01 user nova-compute[74319]: WARNING nova.compute.manager [req-3b21689b-eaaf-48f9-a26c-e557c35f0c6d req-bb12ac0f-9d37-4f4e-9474-8fcb53b1abb4 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state active and task_state reboot_started.
Oct 30 14:40:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance shutdown successfully.
Oct 30 14:40:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:40:03 user nova-compute[74319]: WARNING nova.compute.manager [req-72391c62-d4a1-4c85-a235-359cbc9d225c req-fd44252d-27cf-46a9-8647-43c703315563 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state active and task_state reboot_started.
Oct 30 14:40:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance running successfully.
Oct 30 14:40:05 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance soft rebooted successfully.
Oct 30 14:40:05 user nova-compute[74319]: DEBUG nova.compute.manager [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:40:05 user nova-compute[74319]: WARNING nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state active and task_state reboot_started.
Oct 30 14:40:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:40:05 user nova-compute[74319]: WARNING nova.compute.manager [req-f3c46d58-8e0e-4321-b5fc-42def3f79fea req-aa8cb394-ce62-4a37-8a53-a1e34e589f37 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state active and task_state reboot_started.
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-30ca8027-9a85-4c37-82dc-90c799282824 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.658s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:40:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:40:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:40:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid 2f492328-76b0-4443-bec8-eb366a3bccdd {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Triggering sync for uuid f521f459-e486-49c4-b243-f16741cf9006 {{(pid=74319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "f521f459-e486-49c4-b243-f16741cf9006" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:56 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "f521f459-e486-49c4-b243-f16741cf9006" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:40:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:40:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:40:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.07855987548828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2f492328-76b0-4443-bec8-eb366a3bccdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f7dead57-978f-4268-b841-72cff2fe2d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f521f459-e486-49c4-b243-f16741cf9006 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:40:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:40:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:40:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:40:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:40:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.265s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:40:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:01 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:41:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:41:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid 2f492328-76b0-4443-bec8-eb366a3bccdd {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:41:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:41:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG nova.compute.manager [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing instance network info cache due to event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] Acquiring lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] Acquired lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updated VIF entry in instance network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG nova.network.neutron [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating instance_info_cache with network_info: [{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e14314f4-9b35-4934-afe0-358a9f61d108 req-168995d0-f6ec-4519-8d20-9e3ec1c705d2 service nova] Releasing lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:16 user nova-compute[74319]: INFO nova.compute.manager [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Terminating instance
Oct 30 14:41:16 user nova-compute[74319]: DEBUG nova.compute.manager [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-unplugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-unplugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:41:16 user nova-compute[74319]: DEBUG nova.compute.manager [req-f1c522e6-2485-4d18-9b04-ba18a31dfc9c req-516dc710-b931-4b12-bb85-f79c9789c5a5 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-unplugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] Instance destroyed successfully.
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.objects.instance [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid f521f459-e486-49c4-b243-f16741cf9006 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-223750984',display_name='tempest-TestVolumeBootPattern-server-223750984',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-223750984',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-nlk5zpsn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:39:48Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=f521f459-e486-49c4-b243-f16741cf9006,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_vif [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fb9b4d4-41, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03b14575-5a83-414f-9f38-18d831b3258c) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:17 user nova-compute[74319]: INFO os_vif [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:1c:20,bridge_name='br-int',has_traffic_filtering=True,id=5fb9b4d4-417c-4225-8da7-317e9d1b0b82,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fb9b4d4-41')
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wPsyCcTG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:41:17 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0b181c-b820-47fc-9905-d92ebc631e94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:41:17 user nova-compute[74319]: No targets found.
Oct 30 14:41:17 user nova-compute[74319]: iSNS:
Oct 30 14:41:17 user nova-compute[74319]: No targets found.
Oct 30 14:41:17 user nova-compute[74319]: STATIC:
Oct 30 14:41:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54
Oct 30 14:41:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:41:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:41:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:41:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:41:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:41:17 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a
Oct 30 14:41:17 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:41:17 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:41:17 user nova-compute[74319]: FIRMWARE:
Oct 30 14:41:17 user nova-compute[74319]: No targets found.
Oct 30 14:41:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:41:17 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:41:17 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf9126a-b3ba-4cd0-971b-795f3ca81437]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e74eae1-32ac-4f96-9f86-27307b81d396]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:41:17 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:41:17 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:41:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:41:17 user nova-compute[74319]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a (non-flash)
Oct 30 14:41:17 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:41:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9984456c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a'): ({'sdc'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdc {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[094b8c47-4d2e-461f-b640-1b181c26d5e3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a88262-b6e0-4feb-b171-c493755979b8]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdc {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b7d332-ca16-475b-948f-d2dd315ab868]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec82feb-fc65-4e0b-8f28-518b248f5111]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdc have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO9808c-3c4d2c249335fccd', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9808c', '/dev/disk/by-id/scsi-23363346432633234') {{(pid=85349) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c0bcdc-0c12-45de-86dc-9a2345d7a1c7]: (4, None) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8bd97b-08f3-4a67-aa71-07cd1a7e48b4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.compute.manager [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing instance network info cache due to event network-changed-5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] Acquiring lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] Acquired lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.network.neutron [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Refreshing network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[45945048-8fc7-44cf-92d9-3eb451b7d893]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260]
Oct 30 14:41:17 user nova-compute[74319]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a, portal: 172.16.0.220,3260] successful.
Oct 30 14:41:17 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b04e96-ff30-4c85-b72b-704270ed0f9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7616d5c2-9945-4385-8423-3df58ff4b9c2]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (338ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:41:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Deleting instance files /opt/stack/data/nova/instances/f521f459-e486-49c4-b243-f16741cf9006_del
Oct 30 14:41:17 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Deletion of /opt/stack/data/nova/instances/f521f459-e486-49c4-b243-f16741cf9006_del complete
Oct 30 14:41:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:17 user nova-compute[74319]: INFO nova.compute.manager [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:41:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updated VIF entry in instance network info cache for port 5fb9b4d4-417c-4225-8da7-317e9d1b0b82. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating instance_info_cache with network_info: [{"id": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "address": "fa:16:3e:69:1c:20", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fb9b4d4-41", "ovs_interfaceid": "5fb9b4d4-417c-4225-8da7-317e9d1b0b82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1bb642c2-e31f-4f2d-a1d2-420439e5c128 req-f6a2eb93-2f5f-4723-96c3-2275c53ad835 service nova] Releasing lock "refresh_cache-f521f459-e486-49c4-b243-f16741cf9006" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:18 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: f521f459-e486-49c4-b243-f16741cf9006] Took 1.00 seconds to deallocate network for instance.
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:41:18 user nova-compute[74319]: WARNING nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state active and task_state deleting.
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:41:18 user nova-compute[74319]: WARNING nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state active and task_state deleting.
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:41:18 user nova-compute[74319]: WARNING nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state active and task_state deleting.
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Acquiring lock "f521f459-e486-49c4-b243-f16741cf9006-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] Lock "f521f459-e486-49c4-b243-f16741cf9006-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] No waiting events found dispatching network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:41:18 user nova-compute[74319]: WARNING nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received unexpected event network-vif-plugged-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 for instance with vm_state active and task_state deleting.
Oct 30 14:41:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-8693ac18-3e2d-45dc-a3cf-9810a1646c1e req-e1227ea8-752a-4830-8cd0-ece25b26bd4e service nova] [instance: f521f459-e486-49c4-b243-f16741cf9006] Received event network-vif-deleted-5fb9b4d4-417c-4225-8da7-317e9d1b0b82 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:19 user nova-compute[74319]: INFO nova.compute.manager [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: f521f459-e486-49c4-b243-f16741cf9006] Took 0.97 seconds to detach 1 volumes for instance.
Oct 30 14:41:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:19 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:41:19 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:41:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:19 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance f521f459-e486-49c4-b243-f16741cf9006
Oct 30 14:41:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-763d3ab9-3889-407d-a356-baada6cf79f4 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "f521f459-e486-49c4-b243-f16741cf9006" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.582s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:21 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:21 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:41:21 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:41:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:24 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:41:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:42 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:41:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing instance network info cache due to event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated VIF entry in instance network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-00cb76e8-08b0-42ca-ace2-779d590a3cdf req-94a99438-91ae-4dc1-ac1c-79cd9ce8d414 service nova] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.compute.manager [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing instance network info cache due to event network-changed-807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG nova.network.neutron [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Refreshing network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:50 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:50 user nova-compute[74319]: INFO nova.compute.manager [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Detaching volume 71abcf1f-74c6-433e-bea0-3bd44cedce54
Oct 30 14:41:50 user nova-compute[74319]: INFO nova.virt.block_device [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Attempting to driver detach volume 71abcf1f-74c6-433e-bea0-3bd44cedce54 from mountpoint /dev/vdb
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Attempting to detach device vdb from instance f7dead57-978f-4268-b841-72cff2fe2d36 from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:41:51 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:41:51 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:41:51 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:41:51 user nova-compute[74319]:   <serial>71abcf1f-74c6-433e-bea0-3bd44cedce54</serial>
Oct 30 14:41:51 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:41:51 user nova-compute[74319]: </disk>
Oct 30 14:41:51 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:41:51 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully detached device vdb from instance f7dead57-978f-4268-b841-72cff2fe2d36 from the persistent domain config.
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7dead57-978f-4268-b841-72cff2fe2d36 from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:41:51 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:41:51 user nova-compute[74319]:   <source dev="/dev/sdd"/>
Oct 30 14:41:51 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:41:51 user nova-compute[74319]:   <serial>71abcf1f-74c6-433e-bea0-3bd44cedce54</serial>
Oct 30 14:41:51 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:41:51 user nova-compute[74319]: </disk>
Oct 30 14:41:51 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.network.neutron [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated VIF entry in instance network info cache for port 807af7e6-29d4-4e9c-9372-de45c984fc97. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.network.neutron [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-47ef2bae-6037-4567-87da-a6f681b27c9f req-678162d5-dcfa-46ab-be1f-18e8f4487532 service nova] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:51 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:41:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:41:53 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:41:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:41:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:41:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:41:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=25.076763153076172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:41:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 2f492328-76b0-4443-bec8-eb366a3bccdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance f7dead57-978f-4268-b841-72cff2fe2d36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:41:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:02 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:42:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:06 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [{"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-f7dead57-978f-4268-b841-72cff2fe2d36" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:42:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:42:11 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f7dead57-978f-4268-b841-72cff2fe2d36 is timed out.
Oct 30 14:42:11 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully detached device vdb from instance f7dead57-978f-4268-b841-72cff2fe2d36 from the live domain config.
Oct 30 14:42:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXNgCrO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:42:11 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[275ea392-20f8-4ba7-b914-2b65294fb53f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:42:11 user nova-compute[74319]: No targets found.
Oct 30 14:42:11 user nova-compute[74319]: iSNS:
Oct 30 14:42:11 user nova-compute[74319]: No targets found.
Oct 30 14:42:11 user nova-compute[74319]: STATIC:
Oct 30 14:42:11 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54
Oct 30 14:42:11 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:42:11 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:42:11 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:42:11 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:42:11 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:42:11 user nova-compute[74319]: FIRMWARE:
Oct 30 14:42:11 user nova-compute[74319]: No targets found.
Oct 30 14:42:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:42:11 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:42:11 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadbec63-6b24-4efa-a4de-6e12c0118bc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bfcd21-d027-4893-a79f-0c2ec710b86e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:42:11 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:42:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:42:11 user nova-compute[74319]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 (non-flash)
Oct 30 14:42:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9a013b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54'): ({'sdd'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Removing single pathed devices sdd {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d3e3b1-48eb-47f3-a972-b1d55a1c4967]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cac048-d320-4490-a81d-29440ace0c86]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Flushing IO for device /dev/sdd {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[630d03df-c378-4468-99dd-ccc9c7c081bc]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ea3371-ba3e-4f2e-8bd9-3059c0682877]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] SCSI volumes sdd have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce655ee-d601-437a-8cdb-26c0e7907cf9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b589bf4-99b1-4feb-9f08-1c03f6212bbb]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260]
Oct 30 14:42:11 user nova-compute[74319]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54, portal: 172.16.0.220,3260] successful.
Oct 30 14:42:11 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71abcf1f-74c6-433e-bea0-3bd44cedce54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aa147b-60d1-46cb-bf3b-dacbb6933da0]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] <== disconnect_volume: return (336ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:42:11 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG nova.objects.instance [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'flavor' on Instance uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-501f0e09-d278-46ab-a6c9-d6e5ee9477e6 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.931s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:22 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG nova.compute.manager [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing instance network info cache due to event network-changed-8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] Acquiring lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] Acquired lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG nova.network.neutron [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Refreshing network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:29 user nova-compute[74319]: INFO nova.compute.manager [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Terminating instance
Oct 30 14:42:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-unplugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] No waiting events found dispatching network-vif-unplugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.compute.manager [req-6529bf49-f6f7-4f74-b989-d7f17f06e73d req-aab8485b-a094-4efe-8b22-00b9d442d71c service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-unplugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updated VIF entry in instance network info cache for port 8cc06e71-e6d4-4b70-8d3a-666fc6847372. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.network.neutron [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [{"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-3bfb1ad6-9f69-4c11-ac48-f8852d22decc req-b00440f9-fbd0-4584-b1b6-806739bf132e service nova] Releasing lock "refresh_cache-2f492328-76b0-4443-bec8-eb366a3bccdd" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:42:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Instance destroyed successfully.
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.objects.instance [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lazy-loading 'resources' on Instance uuid 2f492328-76b0-4443-bec8-eb366a3bccdd {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1617039215',display_name='tempest-TestVolumeBootPattern-server-1617039215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1617039215',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFitodbROTLvfiDq1WwCYufBaKKP+k/tvGPFlhXbgplPYqcnOXA71pVUqibomqVQzRdmblnG0UQaXqysJ8I/eZ8nTSE0jAc8Z+1+0Q1vwBssT9P16Hyc8VFT18Hk4c3+w==',key_name='tempest-TestVolumeBootPattern-1674059777',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='090c92eb6b2d4b5987de6989ad9d81f9',ramdisk_id='',reservation_id='r-98biuey3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1283971583',owner_user_name='tempest-TestVolumeBootPattern-1283971583-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:37:38Z,user_data=None,user_id='6923e0bb42604a7f81e9c2980aed33f7',uuid=2f492328-76b0-4443-bec8-eb366a3bccdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converting VIF {"id": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "address": "fa:16:3e:a9:cf:0c", "network": {"id": "3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-205413614-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "090c92eb6b2d4b5987de6989ad9d81f9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc06e71-e6", "ovs_interfaceid": "8cc06e71-e6d4-4b70-8d3a-666fc6847372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_vif [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cc06e71-e6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ce980f8-428a-4bb3-b0d9-d1b519767a30) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:30 user nova-compute[74319]: INFO os_vif [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:cf:0c,bridge_name='br-int',has_traffic_filtering=True,id=8cc06e71-e6d4-4b70-8d3a-666fc6847372,network=Network(3f2fedf8-53bc-4fc3-b45f-fb4a272e3cef),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc06e71-e6')
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrBNevHT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:42:30 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30a80a-155c-4240-80f7-77b900513357]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:42:30 user nova-compute[74319]: No targets found.
Oct 30 14:42:30 user nova-compute[74319]: iSNS:
Oct 30 14:42:30 user nova-compute[74319]: No targets found.
Oct 30 14:42:30 user nova-compute[74319]: STATIC:
Oct 30 14:42:30 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da
Oct 30 14:42:30 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:42:30 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:42:30 user nova-compute[74319]: FIRMWARE:
Oct 30 14:42:30 user nova-compute[74319]: No targets found.
Oct 30 14:42:30 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:42:30 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:42:30 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9c45b9-8b9e-4853-8365-06095f3bdc02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04af0f2-102a-458d-994a-2c6267105ad0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:42:30 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da (non-flash)
Oct 30 14:42:30 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe998699120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[8811ec36-58a8-4f89-83bc-f0903ef75a3c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d2b284-1f62-4b57-bd92-c613df8af3e8]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[888b8f3e-412f-4419-8b0e-d259f23674dd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bfd094-18b8-4912-bb8b-dab7b3a656ec]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0b41d93', '/dev/disk/by-id/scsi-1SCST_BIOf0b41d93-a33ff0689e3b973f', '/dev/disk/by-id/scsi-26133336666303638') {{(pid=85349) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b355a1-dbcb-4ddc-afd8-0d46938643ad]: (4, None) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[00da2316-7a70-4a69-81a7-7ed1f857df97]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cc685d-3de0-4800-bb9c-e47b5a08690a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260]
Oct 30 14:42:30 user nova-compute[74319]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da, portal: 172.16.0.220,3260] successful.
Oct 30 14:42:30 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:edebc7bc-49b8-4e5a-9690-bcc8045d67da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[730d8b28-bb10-44f4-9962-67944976a710]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] <== disconnect_volume: return (310ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:42:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Deleting instance files /opt/stack/data/nova/instances/2f492328-76b0-4443-bec8-eb366a3bccdd_del
Oct 30 14:42:30 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Deletion of /opt/stack/data/nova/instances/2f492328-76b0-4443-bec8-eb366a3bccdd_del complete
Oct 30 14:42:30 user nova-compute[74319]: INFO nova.compute.manager [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Took 1.17 seconds to destroy the instance on the hypervisor.
Oct 30 14:42:30 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:42:30 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:42:31 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:42:31 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Took 0.50 seconds to deallocate network for instance.
Oct 30 14:42:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] Acquiring lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] No waiting events found dispatching network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:42:32 user nova-compute[74319]: WARNING nova.compute.manager [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received unexpected event network-vif-plugged-8cc06e71-e6d4-4b70-8d3a-666fc6847372 for instance with vm_state active and task_state deleting.
Oct 30 14:42:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-bc793486-43c2-4217-a50d-4f57c9e44f50 req-b8920449-a9a0-4e99-a83b-03c668c1ca4b service nova] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Received event network-vif-deleted-8cc06e71-e6d4-4b70-8d3a-666fc6847372 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:32 user nova-compute[74319]: INFO nova.compute.manager [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] [instance: 2f492328-76b0-4443-bec8-eb366a3bccdd] Took 0.93 seconds to detach 1 volumes for instance.
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:32 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Deleted allocations for instance 2f492328-76b0-4443-bec8-eb366a3bccdd
Oct 30 14:42:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-25bf9ccc-5c9f-4860-948f-eafcdca669b1 tempest-TestVolumeBootPattern-1283971583 tempest-TestVolumeBootPattern-1283971583-project-member] Lock "2f492328-76b0-4443-bec8-eb366a3bccdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:42:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:53 user nova-compute[74319]: INFO nova.compute.manager [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Terminating instance
Oct 30 14:42:53 user nova-compute[74319]: DEBUG nova.compute.manager [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:42:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-1a528698-bf2f-47da-b5d3-560d04179f14 req-48e766e8-ff2b-45bb-a597-aad82fafa7a5 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-unplugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Instance destroyed successfully.
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lazy-loading 'resources' on Instance uuid f7dead57-978f-4268-b841-72cff2fe2d36 {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:37:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-671180413',display_name='tempest-TestMinimumBasicScenario-server-671180413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-671180413',id=49,image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHS5LojPoHmiCGJDJY2XuLnSSSXsNmD6WW48dfl+Xmt1hPxQOupkZcmT1lZS/OoRusullzty49ANxfGhYcx8csGrZSbYRZSG6zdSLhJFNNuwN/Ye83Tk3DrVlrb+SA4uRQ==',key_name='tempest-TestMinimumBasicScenario-1332250423',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:37:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a47d65c914c4872916c84cc42b46768',ramdisk_id='',reservation_id='r-qd5glact',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1673d86-89b2-45ca-8b5b-fa4805a075e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-382480661',owner_user_name='tempest-TestMinimumBasicScenario-382480661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:40:06Z,user_data=None,user_id='9fa7c62635fb42cc9044888540c59def',uuid=f7dead57-978f-4268-b841-72cff2fe2d36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converting VIF {"id": "807af7e6-29d4-4e9c-9372-de45c984fc97", "address": "fa:16:3e:95:37:93", "network": {"id": "23a948b5-6557-429c-aea7-e05e1f79b935", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1711182315-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a47d65c914c4872916c84cc42b46768", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap807af7e6-29", "ovs_interfaceid": "807af7e6-29d4-4e9c-9372-de45c984fc97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG os_vif [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap807af7e6-29, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50ca54d8-9e6f-4b00-88e8-02fdb40200e9) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:54 user nova-compute[74319]: INFO os_vif [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:37:93,bridge_name='br-int',has_traffic_filtering=True,id=807af7e6-29d4-4e9c-9372-de45c984fc97,network=Network(23a948b5-6557-429c-aea7-e05e1f79b935),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap807af7e6-29')
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Deleting instance files /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36_del
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Deletion of /opt/stack/data/nova/instances/f7dead57-978f-4268-b841-72cff2fe2d36_del complete
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.compute.manager [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 30 14:42:54 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Took 0.66 seconds to deallocate network for instance.
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-6451ebe7-bb1f-45e6-a74d-ac456c4fed6d req-251725fc-c9c0-421b-a2c3-63cb5d25fb22 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-deleted-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:54 user nova-compute[74319]: INFO nova.compute.manager [req-6451ebe7-bb1f-45e6-a74d-ac456c4fed6d req-251725fc-c9c0-421b-a2c3-63cb5d25fb22 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Neutron deleted interface 807af7e6-29d4-4e9c-9372-de45c984fc97; detaching it from the instance and deleting it from the info cache
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-6451ebe7-bb1f-45e6-a74d-ac456c4fed6d req-251725fc-c9c0-421b-a2c3-63cb5d25fb22 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG nova.compute.manager [req-6451ebe7-bb1f-45e6-a74d-ac456c4fed6d req-251725fc-c9c0-421b-a2c3-63cb5d25fb22 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Detach interface failed, port_id=807af7e6-29d4-4e9c-9372-de45c984fc97, reason: Instance f7dead57-978f-4268-b841-72cff2fe2d36 could not be found. {{(pid=74319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:55 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Deleted allocations for instance f7dead57-978f-4268-b841-72cff2fe2d36
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-59deecd8-5131-4a5e-890c-4d3f4a7d8c96 tempest-TestMinimumBasicScenario-382480661 tempest-TestMinimumBasicScenario-382480661-project-member] Lock "f7dead57-978f-4268-b841-72cff2fe2d36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] Acquiring lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] Lock "f7dead57-978f-4268-b841-72cff2fe2d36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:55 user nova-compute[74319]: DEBUG nova.compute.manager [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] No waiting events found dispatching network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:42:55 user nova-compute[74319]: WARNING nova.compute.manager [req-d564cc71-0b13-49c8-95b8-288cbf72cbea req-b05fdce6-ae3c-4bcb-8cfa-7791fcf7db44 service nova] [instance: f7dead57-978f-4268-b841-72cff2fe2d36] Received unexpected event network-vif-plugged-807af7e6-29d4-4e9c-9372-de45c984fc97 for instance with vm_state deleted and task_state None.
Oct 30 14:42:55 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:42:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:57 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:57 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:42:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:42:58 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9049MB free_disk=25.10213851928711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:42:58 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:42:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:43:02 user nova-compute[74319]: INFO nova.compute.claims [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Claim successful on node user
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:43:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.policy [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68a63df7860447ac9acac7532b8879d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94714c8890594fb68b980a2642ebd147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:43:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Creating image(s)
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "/opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "/opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "/opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "f68f65198c55e40919f7621411c2445def23932d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.197s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk 1073741824" returned: 0 in 0.052s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "f68f65198c55e40919f7621411c2445def23932d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk. size=1073741824 {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Successfully created port: 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.virt.disk.api [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Cannot resize image /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk to a smaller size. {{(pid=74319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Ensure instance console log exists: /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Successfully updated port: 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG nova.compute.manager [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing instance network info cache due to event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:43:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.neutron [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Instance network_info: |[{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Start _get_guest_xml network_info=[{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '6e84464e-b827-48f1-88b9-f2140e869651'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:43:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:43:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-30T13:50:43Z,direct_url=<?>,disk_format='qcow2',id=6e84464e-b827-48f1-88b9-f2140e869651,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='bf96c3970cd743f4bce9faa2e5a4de19',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-30T13:50:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-412480888',display_name='tempest-TestStampPattern-server-412480888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-412480888',id=51,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-7yxc9vvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:43:02Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=d85316f6-fb2c-4006-816c-c97a3a010eca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.objects.instance [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'pci_devices' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:43:04 user nova-compute[74319]:   <uuid>d85316f6-fb2c-4006-816c-c97a3a010eca</uuid>
Oct 30 14:43:04 user nova-compute[74319]:   <name>instance-00000033</name>
Oct 30 14:43:04 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:43:04 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:43:04 user nova-compute[74319]:   <metadata>
Oct 30 14:43:04 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:43:04 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:name>tempest-TestStampPattern-server-412480888</nova:name>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:43:04</nova:creationTime>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:43:04 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:43:04 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:owner>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:user uuid="68a63df7860447ac9acac7532b8879d7">tempest-TestStampPattern-2089061237-project-member</nova:user>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:project uuid="94714c8890594fb68b980a2642ebd147">tempest-TestStampPattern-2089061237</nova:project>
Oct 30 14:43:04 user nova-compute[74319]:       </nova:owner>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:root type="image" uuid="6e84464e-b827-48f1-88b9-f2140e869651"/>
Oct 30 14:43:04 user nova-compute[74319]:       <nova:ports>
Oct 30 14:43:04 user nova-compute[74319]:         <nova:port uuid="1b473e48-d650-4f0b-a7cc-93ff1ec60c5f">
Oct 30 14:43:04 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 30 14:43:04 user nova-compute[74319]:         </nova:port>
Oct 30 14:43:04 user nova-compute[74319]:       </nova:ports>
Oct 30 14:43:04 user nova-compute[74319]:     </nova:instance>
Oct 30 14:43:04 user nova-compute[74319]:   </metadata>
Oct 30 14:43:04 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:43:04 user nova-compute[74319]:     <system>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="serial">d85316f6-fb2c-4006-816c-c97a3a010eca</entry>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="uuid">d85316f6-fb2c-4006-816c-c97a3a010eca</entry>
Oct 30 14:43:04 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:43:04 user nova-compute[74319]:     </system>
Oct 30 14:43:04 user nova-compute[74319]:   </sysinfo>
Oct 30 14:43:04 user nova-compute[74319]:   <os>
Oct 30 14:43:04 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:43:04 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:43:04 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:43:04 user nova-compute[74319]:   </os>
Oct 30 14:43:04 user nova-compute[74319]:   <features>
Oct 30 14:43:04 user nova-compute[74319]:     <acpi/>
Oct 30 14:43:04 user nova-compute[74319]:     <apic/>
Oct 30 14:43:04 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:43:04 user nova-compute[74319]:   </features>
Oct 30 14:43:04 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:43:04 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:43:04 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:43:04 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:43:04 user nova-compute[74319]:   </clock>
Oct 30 14:43:04 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:43:04 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:43:04 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:43:04 user nova-compute[74319]:   </cpu>
Oct 30 14:43:04 user nova-compute[74319]:   <devices>
Oct 30 14:43:04 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:43:04 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:43:04 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk"/>
Oct 30 14:43:04 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:43:04 user nova-compute[74319]:     </disk>
Oct 30 14:43:04 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:43:04 user nova-compute[74319]:       <mac address="fa:16:3e:16:11:b1"/>
Oct 30 14:43:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:43:04 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:43:04 user nova-compute[74319]:       <target dev="tap1b473e48-d6"/>
Oct 30 14:43:04 user nova-compute[74319]:     </interface>
Oct 30 14:43:04 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:43:04 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/console.log" append="off"/>
Oct 30 14:43:04 user nova-compute[74319]:     </serial>
Oct 30 14:43:04 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:43:04 user nova-compute[74319]:     <video>
Oct 30 14:43:04 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:43:04 user nova-compute[74319]:     </video>
Oct 30 14:43:04 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:43:04 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:43:04 user nova-compute[74319]:     </rng>
Oct 30 14:43:04 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:43:04 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:43:04 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:43:04 user nova-compute[74319]:     </memballoon>
Oct 30 14:43:04 user nova-compute[74319]:   </devices>
Oct 30 14:43:04 user nova-compute[74319]: </domain>
Oct 30 14:43:04 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-412480888',display_name='tempest-TestStampPattern-server-412480888',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-412480888',id=51,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-7yxc9vvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:43:02Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=d85316f6-fb2c-4006-816c-c97a3a010eca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG os_vif [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2aa980b7-77f6-589f-8b98-4edcc5eb886e', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b473e48-d6, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b473e48-d6, col_values=(('qos', UUID('4ed9ff48-a555-4729-86a2-100499bc50de')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b473e48-d6, col_values=(('external_ids', {'iface-id': '1b473e48-d650-4f0b-a7cc-93ff1ec60c5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:11:b1', 'vm-uuid': 'd85316f6-fb2c-4006-816c-c97a3a010eca'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:04 user nova-compute[74319]: INFO os_vif [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6')
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No VIF found with MAC fa:16:3e:16:11:b1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated VIF entry in instance network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG nova.network.neutron [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-74d3a58f-e163-4e5c-be01-4d2c68f872ba req-7d261874-6fea-41da-bf46-5af5e496a765 service nova] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:43:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:05 user nova-compute[74319]: DEBUG nova.compute.manager [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] No waiting events found dispatching network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:43:05 user nova-compute[74319]: WARNING nova.compute.manager [req-7e78dc5e-3e41-4fb6-85ac-632f3cb93688 req-39100b03-97fe-4f01-81da-ed32c1eda21e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received unexpected event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f for instance with vm_state building and task_state spawning.
Oct 30 14:43:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:43:07 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Instance spawned successfully.
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_cdrom_bus of ide {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_disk_bus of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_video_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Found default for hw_vif_model of virtio {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:07 user nova-compute[74319]: DEBUG nova.compute.manager [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] No waiting events found dispatching network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:43:07 user nova-compute[74319]: WARNING nova.compute.manager [req-2b19fa2c-db80-4df2-8444-d7a78ba0dee9 req-41ae6659-cb07-454e-a4e4-e6689c9cb9f6 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received unexpected event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f for instance with vm_state building and task_state spawning.
Oct 30 14:43:08 user nova-compute[74319]: INFO nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Took 5.48 seconds to spawn the instance on the hypervisor.
Oct 30 14:43:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:43:08 user nova-compute[74319]: INFO nova.compute.manager [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Took 6.02 seconds to build instance.
Oct 30 14:43:08 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-14372fff-a604-4afa-b38b-77e54d497a08 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.119s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:43:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:43:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:37 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:43:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:56 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:43:59 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:44:00 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:44:00 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.102764129638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:44:00 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:44:01 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:44:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:44:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:44:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:44:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:44:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:44:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:44:52 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:44:53 user nova-compute[74319]: DEBUG nova.compute.manager [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing instance network info cache due to event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:44:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:44:53 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:44:53 user nova-compute[74319]: DEBUG nova.network.neutron [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated VIF entry in instance network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG nova.network.neutron [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-88684d2f-0f44-432d-9491-fb1b1940a74b req-ea0359e7-3172-4c99-a2ff-1b5cf843961a service nova] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:44:54 user nova-compute[74319]: INFO nova.compute.manager [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Attaching volume c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f to /dev/vdb
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.utils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a4d701-b3ed-45c4-808b-172bff0407ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba17a10-d843-4f74-852f-18c770204515]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9d8138-e2b7-4542-b1c7-babb2b7af844]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd9caa0-5c71-4a4e-93e3-0de11da9c382]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:44:54 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:44:54 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a16467-b3e8-4697-896b-1ab85c6eb5a8]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG os_brick.utils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:44:54 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating existing volume attachment record: 3c46c8c8-e788-497d-b038-0587d1760d0a {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:44:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:44:57 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:44:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:45:01 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:45:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:45:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.10138702392578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:45:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:45:03 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:45:03 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:45:03 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:45:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:45:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:45:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:45:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:45:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkZWlCgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:45:13 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:45:13 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:45:13 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eb5c95-abb5-4ce6-827c-68eaf21aaf77]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:45:13 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c513070e-c497-4fac-8359-25606048ef5d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f] added
Oct 30 14:45:13 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd52d5e-22a3-42b0-a336-8caa67787407]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366a99d-e5c1-449a-9b8b-3ea11341dd55]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DkZWlCgp {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DkZWlCgp" returned: 0 in 0.027s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb9adb-51dd-4836-a64b-036169f95f10]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DkZWlCgp'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7577b43-397c-4a90-9df4-4785d2ea177c]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e7fc38-de82-4ed5-bab2-c95616e29bea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:45:13 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:45:13 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:45:13 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:45:13 user nova-compute[74319]: 
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1fd33a-c7c1-49c4-8564-5961735f6b95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260]
Oct 30 14:45:13 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260] successful.
Oct 30 14:45:13 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a276772-df20-4437-b484-973685b0adf1]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3974ecd5-4720-4d46-8772-934ac40003e9]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)
Oct 30 14:45:13 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)
Oct 30 14:45:13 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[71208186-61dc-4157-b500-99c2584d1b8c]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:45:13 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkZWlCgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23736353261643134', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736353261643134', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:45:14 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:45:14 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:45:14 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:45:14 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:45:14 user nova-compute[74319]:   <serial>c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f</serial>
Oct 30 14:45:14 user nova-compute[74319]: </disk>
Oct 30 14:45:14 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:45:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:45:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:45:15 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No VIF found with MAC fa:16:3e:16:11:b1, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:45:15 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7804cb25-8d9a-42c0-85c8-06c6103d5632 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.616s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:45:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:16 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:45:17 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:45:17 user nova-compute[74319]: INFO nova.compute.manager [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Detaching volume c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f
Oct 30 14:45:18 user nova-compute[74319]: INFO nova.virt.block_device [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Attempting to driver detach volume c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f from mountpoint /dev/vdb
Oct 30 14:45:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Attempting to detach device vdb from instance d85316f6-fb2c-4006-816c-c97a3a010eca from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:45:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:45:18 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:45:18 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:45:18 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:45:18 user nova-compute[74319]:   <serial>c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f</serial>
Oct 30 14:45:18 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:45:18 user nova-compute[74319]: </disk>
Oct 30 14:45:18 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:45:18 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully detached device vdb from instance d85316f6-fb2c-4006-816c-c97a3a010eca from the persistent domain config.
Oct 30 14:45:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d85316f6-fb2c-4006-816c-c97a3a010eca from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:45:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:45:18 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:45:18 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:45:18 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:45:18 user nova-compute[74319]:   <serial>c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f</serial>
Oct 30 14:45:18 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:45:18 user nova-compute[74319]: </disk>
Oct 30 14:45:18 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:45:18 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:45:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:45:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:38 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d85316f6-fb2c-4006-816c-c97a3a010eca is timed out.
Oct 30 14:45:38 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully detached device vdb from instance d85316f6-fb2c-4006-816c-c97a3a010eca from the live domain config.
Oct 30 14:45:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DkZWlCgp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:45:38 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dfbcb1-ff00-4aac-b882-6dca8e9bf6c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:45:38 user nova-compute[74319]: No targets found.
Oct 30 14:45:38 user nova-compute[74319]: iSNS:
Oct 30 14:45:38 user nova-compute[74319]: No targets found.
Oct 30 14:45:38 user nova-compute[74319]: STATIC:
Oct 30 14:45:38 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f
Oct 30 14:45:38 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:45:38 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:45:38 user nova-compute[74319]: FIRMWARE:
Oct 30 14:45:38 user nova-compute[74319]: No targets found.
Oct 30 14:45:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:45:38 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:45:38 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50257ea-b041-4ba2-b525-530c599e6170]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc76b7aa-ea9d-444a-885f-72ae0188a4d8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)
Oct 30 14:45:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f (non-flash)
Oct 30 14:45:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe974680310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[598c6876-80b7-4379-851c-e570fe3b2349]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e343af-fc15-41ad-82f9-e4c720c0b6dc]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[319ebf27-87f8-4c1c-b2ae-51d9c2d0b6cd]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81a4e4c-5850-49f7-acae-fbacb44d7253]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[23af11ec-15f0-4c12-b23f-f0658ccd30f6]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3acb3abb-559d-47e0-b5c4-f07852b6c2cb]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260]
Oct 30 14:45:38 user nova-compute[74319]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f, portal: 172.16.0.220,3260] successful.
Oct 30 14:45:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9a1d3d2-3bbf-4d83-92cf-b050d3b8c06f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5228d5-31f6-4d97-8a7f-d6c69b634725]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== disconnect_volume: return (272ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:45:38 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-b9f4ae7e-2bd8-4974-8803-b29b4304a6a1 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.917s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:45:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:45:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:45:59 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:01 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:01 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:46:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.100502014160156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:46:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:04 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:46:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:46:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:46:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:19 user nova-compute[74319]: DEBUG nova.compute.manager [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:46:19 user nova-compute[74319]: INFO nova.compute.manager [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] instance snapshotting
Oct 30 14:46:19 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Beginning live snapshot process
Oct 30 14:46:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json -f qcow2 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d --force-share --output=json" returned: 0 in 0.169s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add.delta 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:20 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f68f65198c55e40919f7621411c2445def23932d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add.delta 1073741824" returned: 0 in 0.051s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:20 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 30 14:46:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:46:21 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 30 14:46:21 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 30 14:46:21 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:46:21 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add.delta /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:22 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add.delta /opt/stack/data/nova/instances/snapshots/tmphd3yrlwt/9bc3d4dfa8f5489885f3420211fb4add" returned: 0 in 0.426s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:22 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Snapshot extracted, beginning image upload
Oct 30 14:46:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:24 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Snapshot image upload complete
Oct 30 14:46:24 user nova-compute[74319]: INFO nova.compute.manager [None req-8117026b-0552-4166-b27f-8e6bb1e1f24c tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Took 4.89 seconds to snapshot the instance on the hypervisor.
Oct 30 14:46:25 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:25 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Starting instance... {{(pid=74319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 30 14:46:26 user nova-compute[74319]: INFO nova.compute.claims [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Claim successful on node user
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Start building networks asynchronously for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Allocating IP information in the background. {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] allocate_for_instance() {{(pid=74319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 30 14:46:26 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 30 14:46:26 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Start building block device mappings for instance. {{(pid=74319) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 30 14:46:26 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG nova.policy [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68a63df7860447ac9acac7532b8879d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94714c8890594fb68b980a2642ebd147', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74319) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Start spawning the instance on the hypervisor. {{(pid=74319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Creating instance directory {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 30 14:46:27 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Creating image(s)
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "/opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "/opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "/opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.part --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:27 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Successfully created port: c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.part --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.virt.images [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] b55e736c-5e21-4966-b7c3-fb2f74ac7a1f was qcow2, converting to raw {{(pid=74319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.privsep.utils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.part /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.converted {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Successfully updated port: c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.compute.manager [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing instance network info cache due to event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] Acquiring lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] Acquired lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing network info cache for port c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.part /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.converted" returned: 0 in 0.583s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.converted --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.799s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.network.neutron [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-e9371e67-5532-4517-b2e9-2914687dbedf req-9fbfa7f9-d403-4e49-8a1f-d54dfdfa3a66 service nova] Releasing lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquired lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:46:28 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Building network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance cache missing network info. {{(pid=74319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json" returned: 0 in 0.389s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json" returned: 0 in 0.166s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc,backing_fmt=raw /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk 1073741824 {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc,backing_fmt=raw /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk 1073741824" returned: 0 in 0.106s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "a2f9c561e5778ff21d96ec93c0ece2f4221294bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.neutron [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Releasing lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance network_info: |[{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a2f9c561e5778ff21d96ec93c0ece2f4221294bc --force-share --output=json" returned: 0 in 0.174s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Created local disks {{(pid=74319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Ensure instance console log exists: /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/console.log {{(pid=74319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Start _get_guest_xml network_info=[{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='34e826813975936e98c26cdf8830b28a',container_format='bare',created_at=2023-10-30T14:46:20Z,direct_url=<?>,disk_format='qcow2',id=b55e736c-5e21-4966-b7c3-fb2f74ac7a1f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1578916749',owner='94714c8890594fb68b980a2642ebd147',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:46:25Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'guest_format': None, 'device_type': 'disk', 'boot_index': 0, 'encryption_options': None, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'b55e736c-5e21-4966-b7c3-fb2f74ac7a1f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 30 14:46:29 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:46:29 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU controller missing on host. {{(pid=74319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.host [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU controller found on host. {{(pid=74319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-30T13:50:32Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='34e826813975936e98c26cdf8830b28a',container_format='bare',created_at=2023-10-30T14:46:20Z,direct_url=<?>,disk_format='qcow2',id=b55e736c-5e21-4966-b7c3-fb2f74ac7a1f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1578916749',owner='94714c8890594fb68b980a2642ebd147',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-30T14:46:25Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flavor limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Image limits 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flavor pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Image pref 0:0:0 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Got 1 possible topologies {{(pid=74319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.hardware [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-361019509',display_name='tempest-TestStampPattern-server-361019509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-361019509',id=52,image_ref='b55e736c-5e21-4966-b7c3-fb2f74ac7a1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-xpd7we5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d85316f6-fb2c-4006-816c-c97a3a010eca',image_min_disk='1',image_min_ram='0',image_owner_id='94714c8890594fb68b980a2642ebd147',image_owner_project_name='tempest-TestStampPattern-2089061237',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2089061237-project-member',image_user_id='68a63df7860447ac9acac7532b8879d7',network_allocated='True',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:46:27Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=838ce734-65f1-4eee-b57e-8700ee7e03ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.objects.instance [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'pci_devices' on Instance uuid 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] End _get_guest_xml xml=<domain type="kvm">
Oct 30 14:46:29 user nova-compute[74319]:   <uuid>838ce734-65f1-4eee-b57e-8700ee7e03ff</uuid>
Oct 30 14:46:29 user nova-compute[74319]:   <name>instance-00000034</name>
Oct 30 14:46:29 user nova-compute[74319]:   <memory>524288</memory>
Oct 30 14:46:29 user nova-compute[74319]:   <vcpu>1</vcpu>
Oct 30 14:46:29 user nova-compute[74319]:   <metadata>
Oct 30 14:46:29 user nova-compute[74319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 30 14:46:29 user nova-compute[74319]:       <nova:package version="0.0.0"/>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:name>tempest-TestStampPattern-server-361019509</nova:name>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:creationTime>2023-10-30 14:46:29</nova:creationTime>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:flavor name="m1.tiny">
Oct 30 14:46:29 user nova-compute[74319]:         <nova:memory>512</nova:memory>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:disk>1</nova:disk>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:swap>0</nova:swap>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:ephemeral>0</nova:ephemeral>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:vcpus>1</nova:vcpus>
Oct 30 14:46:29 user nova-compute[74319]:       </nova:flavor>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:owner>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:user uuid="68a63df7860447ac9acac7532b8879d7">tempest-TestStampPattern-2089061237-project-member</nova:user>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:project uuid="94714c8890594fb68b980a2642ebd147">tempest-TestStampPattern-2089061237</nova:project>
Oct 30 14:46:29 user nova-compute[74319]:       </nova:owner>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:root type="image" uuid="b55e736c-5e21-4966-b7c3-fb2f74ac7a1f"/>
Oct 30 14:46:29 user nova-compute[74319]:       <nova:ports>
Oct 30 14:46:29 user nova-compute[74319]:         <nova:port uuid="c7f1ca44-3425-4d82-993d-e3eb361cc223">
Oct 30 14:46:29 user nova-compute[74319]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 30 14:46:29 user nova-compute[74319]:         </nova:port>
Oct 30 14:46:29 user nova-compute[74319]:       </nova:ports>
Oct 30 14:46:29 user nova-compute[74319]:     </nova:instance>
Oct 30 14:46:29 user nova-compute[74319]:   </metadata>
Oct 30 14:46:29 user nova-compute[74319]:   <sysinfo type="smbios">
Oct 30 14:46:29 user nova-compute[74319]:     <system>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="product">OpenStack Nova</entry>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="version">0.0.0</entry>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="serial">838ce734-65f1-4eee-b57e-8700ee7e03ff</entry>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="uuid">838ce734-65f1-4eee-b57e-8700ee7e03ff</entry>
Oct 30 14:46:29 user nova-compute[74319]:       <entry name="family">Virtual Machine</entry>
Oct 30 14:46:29 user nova-compute[74319]:     </system>
Oct 30 14:46:29 user nova-compute[74319]:   </sysinfo>
Oct 30 14:46:29 user nova-compute[74319]:   <os>
Oct 30 14:46:29 user nova-compute[74319]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 30 14:46:29 user nova-compute[74319]:     <boot dev="hd"/>
Oct 30 14:46:29 user nova-compute[74319]:     <smbios mode="sysinfo"/>
Oct 30 14:46:29 user nova-compute[74319]:   </os>
Oct 30 14:46:29 user nova-compute[74319]:   <features>
Oct 30 14:46:29 user nova-compute[74319]:     <acpi/>
Oct 30 14:46:29 user nova-compute[74319]:     <apic/>
Oct 30 14:46:29 user nova-compute[74319]:     <vmcoreinfo/>
Oct 30 14:46:29 user nova-compute[74319]:   </features>
Oct 30 14:46:29 user nova-compute[74319]:   <clock offset="utc">
Oct 30 14:46:29 user nova-compute[74319]:     <timer name="pit" tickpolicy="delay"/>
Oct 30 14:46:29 user nova-compute[74319]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 30 14:46:29 user nova-compute[74319]:     <timer name="hpet" present="no"/>
Oct 30 14:46:29 user nova-compute[74319]:   </clock>
Oct 30 14:46:29 user nova-compute[74319]:   <cpu mode="custom" match="exact">
Oct 30 14:46:29 user nova-compute[74319]:     <model>Nehalem</model>
Oct 30 14:46:29 user nova-compute[74319]:     <topology sockets="1" cores="1" threads="1"/>
Oct 30 14:46:29 user nova-compute[74319]:   </cpu>
Oct 30 14:46:29 user nova-compute[74319]:   <devices>
Oct 30 14:46:29 user nova-compute[74319]:     <disk type="file" device="disk">
Oct 30 14:46:29 user nova-compute[74319]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 30 14:46:29 user nova-compute[74319]:       <source file="/opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk"/>
Oct 30 14:46:29 user nova-compute[74319]:       <target dev="vda" bus="virtio"/>
Oct 30 14:46:29 user nova-compute[74319]:     </disk>
Oct 30 14:46:29 user nova-compute[74319]:     <interface type="ethernet">
Oct 30 14:46:29 user nova-compute[74319]:       <mac address="fa:16:3e:9c:b1:8c"/>
Oct 30 14:46:29 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:46:29 user nova-compute[74319]:       <mtu size="1442"/>
Oct 30 14:46:29 user nova-compute[74319]:       <target dev="tapc7f1ca44-34"/>
Oct 30 14:46:29 user nova-compute[74319]:     </interface>
Oct 30 14:46:29 user nova-compute[74319]:     <serial type="pty">
Oct 30 14:46:29 user nova-compute[74319]:       <log file="/opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/console.log" append="off"/>
Oct 30 14:46:29 user nova-compute[74319]:     </serial>
Oct 30 14:46:29 user nova-compute[74319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 30 14:46:29 user nova-compute[74319]:     <video>
Oct 30 14:46:29 user nova-compute[74319]:       <model type="virtio"/>
Oct 30 14:46:29 user nova-compute[74319]:     </video>
Oct 30 14:46:29 user nova-compute[74319]:     <rng model="virtio">
Oct 30 14:46:29 user nova-compute[74319]:       <backend model="random">/dev/urandom</backend>
Oct 30 14:46:29 user nova-compute[74319]:     </rng>
Oct 30 14:46:29 user nova-compute[74319]:     <controller type="usb" index="0" model="none"/>
Oct 30 14:46:29 user nova-compute[74319]:     <memballoon model="virtio">
Oct 30 14:46:29 user nova-compute[74319]:       <stats period="10"/>
Oct 30 14:46:29 user nova-compute[74319]:     </memballoon>
Oct 30 14:46:29 user nova-compute[74319]:   </devices>
Oct 30 14:46:29 user nova-compute[74319]: </domain>
Oct 30 14:46:29 user nova-compute[74319]:  {{(pid=74319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-361019509',display_name='tempest-TestStampPattern-server-361019509',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-361019509',id=52,image_ref='b55e736c-5e21-4966-b7c3-fb2f74ac7a1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-xpd7we5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d85316f6-fb2c-4006-816c-c97a3a010eca',image_min_disk='1',image_min_ram='0',image_owner_id='94714c8890594fb68b980a2642ebd147',image_owner_project_name='tempest-TestStampPattern-2089061237',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2089061237-project-member',image_user_id='68a63df7860447ac9acac7532b8879d7',network_allocated='True',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-30T14:46:27Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=838ce734-65f1-4eee-b57e-8700ee7e03ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG os_vif [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34') {{(pid=74319) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e5c4af3-6d19-56e9-a043-6dff1a4c7813', '_type': 'linux-noop'}}, row=False) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7f1ca44-34, may_exist=True, interface_attrs={}) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7f1ca44-34, col_values=(('qos', UUID('497a1a18-8c62-4853-9df8-71cad3dfd8b5')),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7f1ca44-34, col_values=(('external_ids', {'iface-id': 'c7f1ca44-3425-4d82-993d-e3eb361cc223', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:b1:8c', 'vm-uuid': '838ce734-65f1-4eee-b57e-8700ee7e03ff'}),), if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:29 user nova-compute[74319]: INFO os_vif [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34')
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No VIF found with MAC fa:16:3e:9c:b1:8c, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:46:29 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG nova.compute.manager [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] No waiting events found dispatching network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:46:31 user nova-compute[74319]: WARNING nova.compute.manager [req-2b1180b8-b1a2-41ae-b7b4-2587c245e34b req-9d8e0c95-bb8a-4dde-8530-59dec6200569 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received unexpected event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 for instance with vm_state building and task_state spawning.
Oct 30 14:46:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:31 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance event wait completed in 0 seconds for  {{(pid=74319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Guest created on hypervisor {{(pid=74319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 30 14:46:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance spawned successfully.
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Found default for hw_input_bus of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Found default for hw_pointer_model of None {{(pid=74319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 30 14:46:33 user nova-compute[74319]: INFO nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Took 6.25 seconds to spawn the instance on the hypervisor.
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Checking state {{(pid=74319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] No waiting events found dispatching network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:46:33 user nova-compute[74319]: WARNING nova.compute.manager [req-6306c335-13c2-4d90-9551-a7de5d8342dc req-a6e08c4a-ef54-47a1-8f54-2e8689f305c9 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received unexpected event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 for instance with vm_state building and task_state spawning.
Oct 30 14:46:33 user nova-compute[74319]: INFO nova.compute.manager [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Took 6.86 seconds to build instance.
Oct 30 14:46:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-df942f25-0a7f-4329-8d29-e45b214c4ae5 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.017s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:46:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:46:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:56 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:46:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:01 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:01 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:47:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:47:02 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:47:02 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:47:03 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:47:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:47:04 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8831MB free_disk=24.954498291015625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 838ce734-65f1-4eee-b57e-8700ee7e03ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:47:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:06 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:07 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:47:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:47:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:18 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:24 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:47:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:47:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:47:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:48:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:48:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8948MB free_disk=24.95368194580078GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 838ce734-65f1-4eee-b57e-8700ee7e03ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:48:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:48:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:08 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:08 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:10 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:48:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:17 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.compute.manager [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing instance network info cache due to event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] Acquiring lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] Acquired lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing network info cache for port c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updated VIF entry in instance network info cache for port c7f1ca44-3425-4d82-993d-e3eb361cc223. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.network.neutron [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-ad7ca4e0-83a5-4532-b5f3-eb7996c23454 req-9429e3c4-f9d2-4f20-a3df-744eb042db17 service nova] Releasing lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:48:18 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:48:19 user nova-compute[74319]: INFO nova.compute.manager [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Attaching volume bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 to /dev/vdb
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.utils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd64e29f-ef14-416e-82bf-8ecb0718930d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26a7b6be8f21\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea40a77-2455-410f-b3f9-507149f20b6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9584a-1e16-468b-abda-e0ca5516fb22]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218400d-e3ad-4e22-aefa-2771b6d48cb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Running cmd (subprocess): nvme version {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] 'nvme version' failed. Not Retrying. {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] nvme not present on system {{(pid=74319) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 30 14:48:19 user nova-compute[74319]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 30 14:48:19 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2889b4a-b1b3-4f41-89d1-daee735e1d6a]: (4, '') {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74319) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.lightos [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] LIGHTOS: no hostnqn found. {{(pid=74319) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG os_brick.utils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26a7b6be8f21', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG nova.virt.block_device [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating existing volume attachment record: f2ff862e-0dbd-4c7f-a9d5-2c5e9ccd5317 {{(pid=74319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 30 14:48:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:48:21 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:26 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:34 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:36 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Calling os-brick to attach iSCSI Volume {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYXiCGDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:48:37 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:48:37 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:48:37 user nova-compute[74319]: INFO os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1f5f5-d2a1-492a-b2b7-8cea217e7d95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 30 14:48:37 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60fe09d-44c5-412c-b1ac-b607f702d67c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2] added\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2] added
Oct 30 14:48:37 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf1ea12-ccbd-4d91-a365-8df02b38c321]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[46437d71-dbf4-447b-884a-7c9a45e7f764]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYXiCGDF {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uYXiCGDF" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f770eb2-0819-4cee-af28-1422e27df81a]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uYXiCGDF'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e17c0a-4ef6-42c4-bf8c-f99fb23ef9b4]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[29299cae-fe1b-4608-b06d-e55fe94b87be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:48:37 user nova-compute[74319]:  {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:48:37 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 30 14:48:37 user nova-compute[74319]:  {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:48:37 user nova-compute[74319]: WARNING os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 30 14:48:37 user nova-compute[74319]: 
Oct 30 14:48:37 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --login {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4677cc-540a-469c-bc45-23c3f1df1364]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260]
Oct 30 14:48:38 user nova-compute[74319]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260] successful.
Oct 30 14:48:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7c2f3b-eaf7-4b4f-933a-06077c697313]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa95432f-4b6d-4507-a159-b49fff6f5662]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)
Oct 30 14:48:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)
Oct 30 14:48:38 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.234s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Connected to 172.16.0.220:3260 {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74319) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74319) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[26851a37-873d-461c-8f65-54fd51dea815]: (4, ('- - 0', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:48:38 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74319) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYXiCGDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74319) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '26364626461303533', 'path': '/dev/sdb'} {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364626461303533', 'path': '/dev/sdb'} {{(pid=74319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.objects.instance [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] attach device xml: <disk type="block" device="disk">
Oct 30 14:48:39 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:48:39 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:48:39 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:48:39 user nova-compute[74319]:   <serial>bc3d6804-ad7a-4b8e-a7ce-770dea2223e2</serial>
Oct 30 14:48:39 user nova-compute[74319]: </disk>
Oct 30 14:48:39 user nova-compute[74319]:  {{(pid=74319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vda, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] No VIF found with MAC fa:16:3e:9c:b1:8c, not building metadata {{(pid=74319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-7cef4dd2-5c7c-4252-b211-40e8279fbe53 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.488s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:48:39 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:41 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:48:41 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:48:41 user nova-compute[74319]: INFO nova.compute.manager [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Detaching volume bc3d6804-ad7a-4b8e-a7ce-770dea2223e2
Oct 30 14:48:41 user nova-compute[74319]: INFO nova.virt.block_device [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Attempting to driver detach volume bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 from mountpoint /dev/vdb
Oct 30 14:48:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Attempting to detach device vdb from instance 838ce734-65f1-4eee-b57e-8700ee7e03ff from the persistent domain config. {{(pid=74319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 30 14:48:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:48:42 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:48:42 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:48:42 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:48:42 user nova-compute[74319]:   <serial>bc3d6804-ad7a-4b8e-a7ce-770dea2223e2</serial>
Oct 30 14:48:42 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:48:42 user nova-compute[74319]: </disk>
Oct 30 14:48:42 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:48:42 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully detached device vdb from instance 838ce734-65f1-4eee-b57e-8700ee7e03ff from the persistent domain config.
Oct 30 14:48:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 838ce734-65f1-4eee-b57e-8700ee7e03ff from the live domain config. {{(pid=74319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 30 14:48:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.guest [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] detach device xml: <disk type="block" device="disk">
Oct 30 14:48:42 user nova-compute[74319]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 30 14:48:42 user nova-compute[74319]:   <source dev="/dev/sdb"/>
Oct 30 14:48:42 user nova-compute[74319]:   <target dev="vdb" bus="virtio"/>
Oct 30 14:48:42 user nova-compute[74319]:   <serial>bc3d6804-ad7a-4b8e-a7ce-770dea2223e2</serial>
Oct 30 14:48:42 user nova-compute[74319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 30 14:48:42 user nova-compute[74319]: </disk>
Oct 30 14:48:42 user nova-compute[74319]:  {{(pid=74319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 30 14:48:42 user nova-compute[74319]: DEBUG nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 30 14:48:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:46 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:49 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:51 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:54 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:48:59 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:02 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 838ce734-65f1-4eee-b57e-8700ee7e03ff is timed out.
Oct 30 14:49:02 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully detached device vdb from instance 838ce734-65f1-4eee-b57e-8700ee7e03ff from the live domain config.
Oct 30 14:49:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] calling os-brick to detach iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9a044a0e0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uYXiCGDF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 30 14:49:02 user nova-compute[74319]: WARNING os_brick.initiator.connectors.base [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2eaf46-878e-4cd7-850d-c1bbe641c8b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 30 14:49:02 user nova-compute[74319]: No targets found.
Oct 30 14:49:02 user nova-compute[74319]: iSNS:
Oct 30 14:49:02 user nova-compute[74319]: No targets found.
Oct 30 14:49:02 user nova-compute[74319]: STATIC:
Oct 30 14:49:02 user nova-compute[74319]: Target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2
Oct 30 14:49:02 user nova-compute[74319]:         Portal: 172.16.0.220:3260,-1
Oct 30 14:49:02 user nova-compute[74319]:                 Iface Name: default
Oct 30 14:49:02 user nova-compute[74319]: FIRMWARE:
Oct 30 14:49:02 user nova-compute[74319]: No targets found.
Oct 30 14:49:02 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 30 14:49:02 user nova-compute[74319]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 30 14:49:02 user nova-compute[74319]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74319) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2', 0)] {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[e026d198-5e7b-4b3b-9139-bfa615c38643]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e54236-d91b-4020-9932-ee1bc854e3d4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)
Oct 30 14:49:02 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 (non-flash)
Oct 30 14:49:02 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe99837d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2'): ({'sdb'}, set())}) {{(pid=74319) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Removing single pathed devices sdb {{(pid=74319) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1a4e7d-45f4-4003-8919-eab94a25b479]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[f811cf0c-30c3-4ec0-a822-139b8956437a]: (4, ('ok\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Flushing IO for device /dev/sdb {{(pid=74319) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d4de72-feca-4c67-888f-83b6ce74d67b]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74319) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5d647a-21fc-41c5-b938-698f0a199dc7]: (4, ('1', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.linuxscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] SCSI volumes sdb have been removed. {{(pid=74319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2')] {{(pid=74319) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a3eb2-1300-43a5-8814-eb9019cb73e9]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --logout {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[3229e734-4447-480a-8264-dc0c745a467f]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260]
Oct 30 14:49:02 user nova-compute[74319]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2, portal: 172.16.0.220,3260] successful.
Oct 30 14:49:02 user nova-compute[74319]:  stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op delete {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc3d6804-ad7a-4b8e-a7ce-770dea2223e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85349) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fff0ef-aba3-47db-b72d-5545b1aa6538]: (4, ('', '')) {{(pid=85349) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74319) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.base [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG os_brick.initiator.connectors.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] <== disconnect_volume: return (264ms) None {{(pid=74319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Disconnected iSCSI Volume {{(pid=74319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 30 14:49:02 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:03 user nova-compute[74319]: DEBUG nova.objects.instance [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'flavor' on Instance uuid 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:49:03 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-64693ccf-ed34-46c0-9b7e-dc0618515135 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:04 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:49:05 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:49:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:49:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8921MB free_disk=24.952499389648438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance 838ce734-65f1-4eee-b57e-8700ee7e03ff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:49:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:07 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:09 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:49:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:49:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Forcefully refreshing network info cache for instance {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG nova.objects.instance [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lazy-loading 'info_cache' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG nova.network.neutron [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated the network info_cache for instance {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 30 14:49:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:19 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:24 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:27 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:29 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG nova.compute.manager [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing instance network info cache due to event network-changed-c7f1ca44-3425-4d82-993d-e3eb361cc223. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] Acquiring lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] Acquired lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG nova.network.neutron [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Refreshing network info cache for port c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:32 user nova-compute[74319]: INFO nova.compute.manager [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Terminating instance
Oct 30 14:49:32 user nova-compute[74319]: DEBUG nova.compute.manager [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:32 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-unplugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] No waiting events found dispatching network-vif-unplugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.compute.manager [req-665934e2-a8a1-4664-856a-27b599928662 req-54a3b0c3-7960-4c0a-8da8-af02c8b0a47d service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-unplugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updated VIF entry in instance network info cache for port c7f1ca44-3425-4d82-993d-e3eb361cc223. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.neutron [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [{"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-07fd6911-0ba2-479b-af5f-9e26abd5a520 req-262fb841-4795-4fda-b11a-f37703865868 service nova] Releasing lock "refresh_cache-838ce734-65f1-4eee-b57e-8700ee7e03ff" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:49:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Instance destroyed successfully.
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.objects.instance [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'resources' on Instance uuid 838ce734-65f1-4eee-b57e-8700ee7e03ff {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-361019509',display_name='tempest-TestStampPattern-server-361019509',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-361019509',id=52,image_ref='b55e736c-5e21-4966-b7c3-fb2f74ac7a1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:46:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-xpd7we5z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='d85316f6-fb2c-4006-816c-c97a3a010eca',image_min_disk='1',image_min_ram='0',image_owner_id='94714c8890594fb68b980a2642ebd147',image_owner_project_name='tempest-TestStampPattern-2089061237',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-2089061237-project-member',image_user_id='68a63df7860447ac9acac7532b8879d7',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:46:33Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=838ce734-65f1-4eee-b57e-8700ee7e03ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "address": "fa:16:3e:9c:b1:8c", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7f1ca44-34", "ovs_interfaceid": "c7f1ca44-3425-4d82-993d-e3eb361cc223", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG os_vif [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7f1ca44-34, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=497a1a18-8c62-4853-9df8-71cad3dfd8b5) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:33 user nova-compute[74319]: INFO os_vif [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:b1:8c,bridge_name='br-int',has_traffic_filtering=True,id=c7f1ca44-3425-4d82-993d-e3eb361cc223,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7f1ca44-34')
Oct 30 14:49:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Deleting instance files /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff_del
Oct 30 14:49:33 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Deletion of /opt/stack/data/nova/instances/838ce734-65f1-4eee-b57e-8700ee7e03ff_del complete
Oct 30 14:49:33 user nova-compute[74319]: INFO nova.compute.manager [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:49:33 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:49:33 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Took 0.37 seconds to deallocate network for instance.
Oct 30 14:49:33 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:34 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:49:34 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:49:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:34 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Deleted allocations for instance 838ce734-65f1-4eee-b57e-8700ee7e03ff
Oct 30 14:49:34 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-dae0768c-37ec-40d9-a495-5f42f38c2dab tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.550s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:34 user nova-compute[74319]: DEBUG nova.compute.manager [req-f532710c-eb08-4e62-80ba-f3cfad7f748b req-6a732549-1242-4a69-a2cb-8fd12ebd6945 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-deleted-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:49:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:49:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] Acquiring lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:49:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:49:35 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] Lock "838ce734-65f1-4eee-b57e-8700ee7e03ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:49:35 user nova-compute[74319]: DEBUG nova.compute.manager [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] No waiting events found dispatching network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:49:35 user nova-compute[74319]: WARNING nova.compute.manager [req-5644c124-9d62-48a2-8d6f-0a4e6c6de9a3 req-7f199923-7fa7-4b13-9982-db0b45dffef7 service nova] [instance: 838ce734-65f1-4eee-b57e-8700ee7e03ff] Received unexpected event network-vif-plugged-c7f1ca44-3425-4d82-993d-e3eb361cc223 for instance with vm_state deleted and task_state None.
Oct 30 14:49:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:48 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:49:53 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:49:58 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:03 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:05 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:05 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:05 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.processutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74319) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 30 14:50:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:50:06 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=24.94532012939453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Instance d85316f6-fb2c-4006-816c-c97a3a010eca actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:50:06 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:50:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:50:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:08 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:09 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:50:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:50:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:50:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:13 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:15 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:18 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74319) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74319) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 30 14:50:23 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:28 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:33 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:38 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:43 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing instance network info cache due to event network-changed-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] Acquiring lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] Acquired lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Refreshing network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:44 user nova-compute[74319]: INFO nova.compute.manager [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Terminating instance
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Start destroying the instance on the hypervisor. {{(pid=74319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-unplugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] No waiting events found dispatching network-vif-unplugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.compute.manager [req-bf6473c2-b39a-41c2-b28a-6decd91b6d8f req-d50d20e8-0f5e-4724-a543-91e42c1c6b2e service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-unplugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f for instance with task_state deleting. {{(pid=74319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updated VIF entry in instance network info cache for port 1b473e48-d650-4f0b-a7cc-93ff1ec60c5f. {{(pid=74319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG nova.network.neutron [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [{"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:50:44 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-31f32cee-e65c-4db2-bf4c-dbaabddfbf59 req-f304ae4c-42d1-4287-811b-689802a38279 service nova] Releasing lock "refresh_cache-d85316f6-fb2c-4006-816c-c97a3a010eca" {{(pid=74319) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Instance destroyed successfully.
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.objects.instance [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lazy-loading 'resources' on Instance uuid d85316f6-fb2c-4006-816c-c97a3a010eca {{(pid=74319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.virt.libvirt.vif [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-30T14:43:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-412480888',display_name='tempest-TestStampPattern-server-412480888',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-412480888',id=51,image_ref='6e84464e-b827-48f1-88b9-f2140e869651',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5JI0K99F+/LFUu71HMmYDN8jF5iQnA0XI4vI9H0VB8Ni2L5j4MqcKSgbnYel4L+mKDdArOUQ6cZn0UecAeUgg981jb+aYUQtqBNUFYKZQJNlyfbS71E0s6MJ0OYaTN+g==',key_name='tempest-TestStampPattern-616283574',keypairs=<?>,launch_index=0,launched_at=2023-10-30T14:43:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94714c8890594fb68b980a2642ebd147',ramdisk_id='',reservation_id='r-7yxc9vvs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6e84464e-b827-48f1-88b9-f2140e869651',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-2089061237',owner_user_name='tempest-TestStampPattern-2089061237-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-30T14:46:25Z,user_data=None,user_id='68a63df7860447ac9acac7532b8879d7',uuid=d85316f6-fb2c-4006-816c-c97a3a010eca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converting VIF {"id": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "address": "fa:16:3e:16:11:b1", "network": {"id": "ec622e4b-778d-4ef8-87e1-c157917627b1", "bridge": "br-int", "label": "tempest-TestStampPattern-1897100904-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94714c8890594fb68b980a2642ebd147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b473e48-d6", "ovs_interfaceid": "1b473e48-d650-4f0b-a7cc-93ff1ec60c5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.network.os_vif_util [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6') {{(pid=74319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG os_vif [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6') {{(pid=74319) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b473e48-d6, bridge=br-int, if_exists=True) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ed9ff48-a555-4729-86a2-100499bc50de) {{(pid=74319) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:50:45 user nova-compute[74319]: INFO os_vif [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:11:b1,bridge_name='br-int',has_traffic_filtering=True,id=1b473e48-d650-4f0b-a7cc-93ff1ec60c5f,network=Network(ec622e4b-778d-4ef8-87e1-c157917627b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b473e48-d6')
Oct 30 14:50:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Deleting instance files /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca_del
Oct 30 14:50:45 user nova-compute[74319]: INFO nova.virt.libvirt.driver [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Deletion of /opt/stack/data/nova/instances/d85316f6-fb2c-4006-816c-c97a3a010eca_del complete
Oct 30 14:50:45 user nova-compute[74319]: INFO nova.compute.manager [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 30 14:50:45 user nova-compute[74319]: DEBUG oslo.service.loopingcall [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74319) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.compute.manager [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Deallocating network for instance {{(pid=74319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] deallocate_for_instance() {{(pid=74319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.network.neutron [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Updating instance_info_cache with network_info: [] {{(pid=74319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 30 14:50:45 user nova-compute[74319]: INFO nova.compute.manager [-] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Took 0.46 seconds to deallocate network for instance.
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:50:45 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:46 user nova-compute[74319]: INFO nova.scheduler.client.report [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Deleted allocations for instance d85316f6-fb2c-4006-816c-c97a3a010eca
Oct 30 14:50:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-56b12fcd-9d09-475d-9db6-80c52c29fcd0 tempest-TestStampPattern-2089061237 tempest-TestStampPattern-2089061237-project-member] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.622s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-b9a92ffb-8ce2-49d0-9382-68ffc05093ad req-61461d83-74f1-4d21-bb3a-181459d78387 service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-deleted-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] Acquiring lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] Lock "d85316f6-fb2c-4006-816c-c97a3a010eca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:50:46 user nova-compute[74319]: DEBUG nova.compute.manager [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] No waiting events found dispatching network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f {{(pid=74319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 30 14:50:46 user nova-compute[74319]: WARNING nova.compute.manager [req-2a89749b-5477-4a70-9df1-610c3311a96f req-8caa8942-721c-47e0-998d-0e8c44cc683f service nova] [instance: d85316f6-fb2c-4006-816c-c97a3a010eca] Received unexpected event network-vif-plugged-1b473e48-d650-4f0b-a7cc-93ff1ec60c5f for instance with vm_state deleted and task_state None.
Oct 30 14:50:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:50:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:03 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:51:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:51:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:51:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:51:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:51:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9132MB free_disk=25.06985092163086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:51:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:51:09 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:11 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:11 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:51:12 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:16 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:17 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:20 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:20 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:25 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:30 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:30 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:35 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:35 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:37 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 30 14:51:37 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] There are 0 instances to clean {{(pid=74319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 30 14:51:39 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:39 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 30 14:51:40 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:51:45 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:47 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:50 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:51:51 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:51:55 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:52:00 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 30 14:52:04 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:05 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:52:06 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:52:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:52:06 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:52:06 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Auditing locally available compute resources for user (node: user) {{(pid=74319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 30 14:52:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:52:07 user nova-compute[74319]: WARNING nova.virt.libvirt.driver [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Hypervisor/Node resource view: name=user free_ram=9281MB free_disk=25.066150665283203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing inventories for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating ProviderTree inventory for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Updating inventory in ProviderTree for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing aggregate associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, aggregates: None {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Refreshing trait associations for resource provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE2,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSSE3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_MMX,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41 {{(pid=74319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.provider_tree [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed in ProviderTree for provider: 8f3b70bc-49f7-41d1-83ac-bc539bcc795e {{(pid=74319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.scheduler.client.report [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Inventory has not changed for provider 8f3b70bc-49f7-41d1-83ac-bc539bcc795e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG nova.compute.resource_tracker [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Compute_service record updated for user:user {{(pid=74319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 30 14:52:07 user nova-compute[74319]: DEBUG oslo_concurrency.lockutils [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=74319) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 30 14:52:10 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 30 14:52:10 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Starting heal instance info cache {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Rebuilding the list of instances to heal {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Didn't find any instances for network info cache update. {{(pid=74319) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:13 user nova-compute[74319]: DEBUG nova.compute.manager [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 30 14:52:14 user nova-compute[74319]: DEBUG oslo_service.periodic_task [None req-fd4781ac-cfd3-4e22-aefd-7cfed3fca046 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74319) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 30 14:52:15 user nova-compute[74319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74319) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}